Apr 28 19:09:02 devstack cinder-volume[75161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75161) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 28 19:09:02 devstack cinder-volume[75161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75161) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 28 19:09:02 devstack cinder-volume[75161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75161) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 28 19:09:02 devstack cinder-volume[75161]: INFO dbcounter [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] Registered counter for database cinder Apr 28 19:09:02 devstack cinder-volume[75161]: DEBUG oslo_db.sqlalchemy.engines [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75161) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG dbcounter [-] [75161] Writer thread running {{(pid=75161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 28 19:09:03 devstack cinder-volume[75161]: INFO cinder.rpc [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 28 19:09:03 devstack cinder-volume[75161]: INFO cinder.rpc [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_db.sqlalchemy.engines [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75161) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 19:09:03 devstack cinder-volume[75161]: INFO cinder.volume.manager [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] Determined volume DB was empty at startup. Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG cinder.volume.manager [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75161) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 28 19:09:03 devstack cinder-volume[75161]: INFO cinder.volume.manager [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 28 19:09:03 devstack cinder-volume[75161]: WARNING stevedore.named [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 28 19:09:03 devstack cinder-volume[75161]: WARNING castellan.key_manager [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 28 19:09:03 devstack cinder-volume[75161]: WARNING cinder.keymgr.conf_key_mgr [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG cinder.volume.drivers.lvm [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75161) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_concurrency.processutils [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] CMD "cinder-rtstool verify" returned: 0 in 0.387s {{(pid=75161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_db.sqlalchemy.engines [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75161) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 19:09:03 devstack cinder-volume[75161]: INFO cinder.rpc [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 28 19:09:03 devstack cinder-volume[75161]: INFO cinder.rpc [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 28 19:09:03 devstack cinder-volume[75161]: WARNING stevedore.named [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 28 19:09:03 devstack cinder-volume[75161]: WARNING castellan.key_manager [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 28 19:09:03 devstack cinder-volume[75161]: INFO cinder.volume.manager [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_db.sqlalchemy.engines [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75161) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 19:09:03 devstack cinder-volume[75161]: INFO oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] Starting 1 workers Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] Started child 75331 {{(pid=75161) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] Full set of CONF: {{(pid=75161) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] ******************************************************************************** {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] Configuration options gathered from: {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] ================================================================================ {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] allow_availability_zone_fallback = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] allow_compression_on_image_upload = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] allowed_direct_url_schemes = [] {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] api_rate_limit = True {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] auth_strategy = keystone {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] az_cache_duration = 3600 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_availability_zone = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_host = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_name = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75331]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0) Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_stats_polling_interval = 60 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backup_api_class = cinder.backup.api.API {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backup_name_template = backup-%s {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backup_use_same_host = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backup_use_temp_snapshot = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] chap_password = **** {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] chap_username = {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] cinder_internal_tenant_project_id = 01521d64056246c4a245e5f872643f6c {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] cinder_internal_tenant_user_id = 5cbefb6a41534ec082ace1a270e6689c {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] cloned_volume_same_az = True {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] cluster = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] compression_format = gzip {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] compute_api_class = cinder.compute.nova.API {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] config_dir = [] {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] config_source = [] {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] control_exchange = openstack {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] debug = True {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] default_availability_zone = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] default_group_type = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] default_volume_type = lvmdriver-1 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] disk_geometry = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] driver_client_cert = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] driver_client_cert_key = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] driver_data_namespace = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] driver_ssl_cert_path = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] driver_ssl_cert_verify = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] driver_use_ssl = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] enable_force_upload = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] enable_new_services = True {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] enable_unsupported_driver = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] enabled_backends = ['lvmdriver-1'] {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] enforce_multipath_for_image_xfer = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] filter_function = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] glance_api_insecure = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] glance_api_servers = ['http://192.168.122.89/image'] {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] glance_api_ssl_compression = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] glance_ca_certificates_file = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] glance_catalog_info = image:glance:publicURL {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] glance_certfile = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] glance_keyfile = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] glance_num_retries = 3 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] glance_request_timeout = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] goodness_function = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] graceful_shutdown_timeout = 5 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] group_api_class = cinder.group.api.API {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] host = devstack {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] image_compress_on_upload = True {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] image_conversion_address_space_limit = 1 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] image_conversion_cpu_limit = 60 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] image_conversion_disable = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] image_upload_use_cinder_backend = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] image_upload_use_internal_tenant = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] image_volume_cache_enabled = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] image_volume_cache_max_count = 0 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] image_volume_cache_max_size_gb = 0 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] init_host_max_objects_retrieval = 0 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] instance_format = [instance: %(uuid)s] {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] iscsi_target_flags = {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75331]: INFO cinder.volume.manager [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] iscsi_write_cache = on {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] iser_helper = tgtadm {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] iser_ip_address = 192.168.122.89 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] iser_port = 3260 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] log_color = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] log_config_append = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] log_dir = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] log_file = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] log_options = True {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] log_rotate_interval = 1 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] log_rotate_interval_type = days {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] log_rotation_type = none {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] max_age = 0 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] max_logfile_count = 30 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] max_logfile_size_mb = 200 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] max_over_subscription_ratio = 20.0 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] message_reap_interval = 86400 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] message_ttl = 2592000 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] migration_create_volume_timeout_secs = 300 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] monkey_patch = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] monkey_patch_modules = [] {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] my_ip = 192.168.122.89 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] no_snapshot_gb_quota = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] num_iser_scan_tries = 3 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] num_shell_tries = 3 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] num_volume_device_scan_tries = 3 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] nvmeof_conn_info_version = 1 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] nvmet_ns_id = 10 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] nvmet_port_id = 1 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] osapi_max_limit = 1000 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] osapi_volume_ext_list = [] {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] osapi_volume_listen = 0.0.0.0 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] osapi_volume_listen_port = 8776 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] osapi_volume_use_ssl = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] osapi_volume_workers = 2 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] per_volume_size_limit = -1 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] periodic_fuzzy_delay = 60 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] periodic_interval = 60 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] project_id_regex = [0-9a-f\-]+ {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] public_endpoint = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] publish_errors = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] quota_backup_gigabytes = 1000 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] quota_backups = 10 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] quota_gigabytes = 1000 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] quota_groups = 10 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] quota_snapshots = 10 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] quota_volumes = 10 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] rate_limit_burst = 0 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] rate_limit_except_level = CRITICAL {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] rate_limit_interval = 0 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] reinit_driver_count = 3 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] replication_device = **** {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] report_discard_supported = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] report_interval = 120 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] reservation_clean_interval = 86400 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] reservation_expire = 86400 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] reserved_image_namespaces = [] {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] reserved_percentage = 0 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] rpc_response_timeout = 120 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] run_external_periodic_tasks = True {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] scst_target_driver = iscsi {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] scst_target_iqn_name = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] service_down_time = 720 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] shell_completion = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] snapshot_name_template = snapshot-%s {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] snapshot_same_host = True {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] split_loggers = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] state_path = /opt/stack/data/cinder {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] storage_availability_zone = nova {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] storage_protocol = iSCSI {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] syslog_log_facility = LOG_USER {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] target_helper = lioadm {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] target_ip_address = 192.168.122.89 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] target_port = 3260 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] target_protocol = iscsi {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] target_secondary_ip_addresses = [] {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] trace_flags = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] transfer_api_class = cinder.transfer.api.API {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] transport_url = **** {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] until_refresh = 0 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] use_chap_auth = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] use_default_quota_class = True {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] use_journal = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] use_json = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] use_multipath_for_image_xfer = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] use_stderr = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] use_syslog = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] verify_glance_signatures = enabled {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] volume_api_class = cinder.volume.api.API {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] volume_backend_name = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] volume_clear = zero {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] volume_clear_ionice = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] volume_clear_size = 0 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] volume_copy_bps_limit = 0 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] volume_dd_blocksize = 1M {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] volume_name_template = volume-%s {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] volume_service_inithost_offload = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] volume_usage_audit_period = month {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] zoning_mode = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_concurrency.disable_process_locking = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] keystone_authtoken.admin_password = **** {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] keystone_authtoken.admin_token = **** {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] keystone_authtoken.admin_user = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] keystone_authtoken.auth_admin_prefix = {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] keystone_authtoken.auth_port = 35357 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] keystone_authtoken.auth_protocol = https {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] keystone_authtoken.auth_section = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] keystone_authtoken.auth_type = password {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] keystone_authtoken.auth_uri = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] keystone_authtoken.auth_version = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] keystone_authtoken.cache = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] keystone_authtoken.certfile = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] keystone_authtoken.delay_auth_decision = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] keystone_authtoken.http_connect_timeout = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] keystone_authtoken.identity_uri = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] keystone_authtoken.include_service_catalog = True {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] keystone_authtoken.insecure = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] keystone_authtoken.interface = public {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] keystone_authtoken.keyfile = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] keystone_authtoken.memcache_password = {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] keystone_authtoken.memcache_username = {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] keystone_authtoken.region_name = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] keystone_authtoken.service_token_roles_required = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] keystone_authtoken.service_type = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] keystone_authtoken.token_cache_time = 300 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.89/identity {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] cache.backend = dogpile.cache.null {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] cache.backend_argument = **** {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] cache.backend_expiration_time = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] cache.config_prefix = cache.oslo {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] cache.debug_cache_backend = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] cache.enable_retry_client = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] cache.enable_socket_keepalive = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] cache.enabled = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] cache.enforce_fips_mode = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] cache.expiration_time = 600 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] cache.hashclient_retry_attempts = 2 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] cache.memcache_dead_retry = 300 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] cache.memcache_pool_maxsize = 10 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:09:03 devstack sudo[75335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] cache.memcache_sasl_enabled = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] cache.password = **** {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:03 devstack sudo[75335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:09:04 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] cache.proxies = [] {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] cache.redis_db = 0 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] cache.redis_sentinel_service_name = mymaster {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] cache.redis_server = localhost:6379 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] cache.retry_attempts = 2 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] cache.retry_delay = 0.0 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] cache.socket_keepalive_count = 1 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] cache.socket_keepalive_idle = 1 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] cache.socket_keepalive_interval = 1 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] cache.socket_timeout = 1.0 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] cache.tls_allowed_ciphers = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] cache.tls_cafile = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] cache.tls_certfile = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] cache.tls_enabled = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] cache.tls_keyfile = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] cache.username = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] coordination.backend_url = **** {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] database.asyncio_connection = **** {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] database.asyncio_slave_connection = **** {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] database.backend = sqlalchemy {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] database.connection = **** {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] database.connection_debug = 0 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] database.connection_parameters = {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] database.connection_recycle_time = 3600 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] database.connection_trace = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] database.db_inc_retry_interval = True {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] database.db_max_retries = 20 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] database.db_max_retry_interval = 10 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] database.db_retry_interval = 1 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] database.max_overflow = 50 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] database.max_pool_size = 5 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] database.max_retries = 10 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] database.mysql_wsrep_sync_wait = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] database.pool_timeout = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] database.retry_interval = 10 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] database.slave_connection = **** {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] database.sqlite_synchronous = True {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] database.synchronous_reader = True {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] database.use_db_reconnect = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] profiler.connection_string = messaging:// {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] profiler.enabled = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] profiler.es_doc_type = notification {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] profiler.es_scroll_size = 10000 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] profiler.es_scroll_time = 2m {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] profiler.filter_error_trace = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] profiler.hmac_keys = **** {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] profiler.sentinel_service_name = mymaster {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] profiler.socket_timeout = 0.1 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] profiler.trace_requests = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] profiler.trace_sqlalchemy = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] profiler_jaeger.process_tags = {} {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] profiler_jaeger.service_name_prefix = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] profiler_otlp.service_name_prefix = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_policy.enforce_new_defaults = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: WARNING oslo_config.cfg [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_policy.enforce_scope = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_policy.policy_default_rule = default {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_policy.policy_file = policy.yaml {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_policy.remote_timeout = 60.0 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] privsep_osbrick.group = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] privsep_osbrick.helper_command = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] privsep_osbrick.user = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] cinder_sys_admin.group = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] cinder_sys_admin.helper_command = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] cinder_sys_admin.user = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] service_user.auth_section = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] service_user.auth_type = password {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] service_user.cafile = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] service_user.certfile = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] service_user.collect_timing = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] service_user.insecure = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] service_user.keyfile = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] service_user.send_service_user_token = True {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] service_user.split_loggers = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] service_user.timeout = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] glance.auth_section = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] glance.auth_type = password {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] glance.certfile = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] glance.collect_timing = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] glance.insecure = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] glance.keyfile = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] glance.region_name = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] glance.split_loggers = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] glance.timeout = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.backend_availability_zone = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.chap_password = **** {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.chap_username = {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.disk_geometry = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.driver_client_cert = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.driver_client_cert_key = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.driver_data_namespace = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.driver_use_ssl = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.enable_unsupported_driver = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.extra_capabilities = {} {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.filter_function = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.goodness_function = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.iscsi_target_flags = {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.iscsi_write_cache = on {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.iser_helper = tgtadm {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.iser_ip_address = 192.168.122.89 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.iser_port = 3260 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.lvm_mirrors = 0 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.lvm_share_target = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.lvm_type = auto {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.num_shell_tries = 3 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.nvmet_port_id = 1 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.replication_device = **** {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.report_discard_supported = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.reserved_percentage = 0 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.scst_target_driver = iscsi {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.scst_target_iqn_name = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.storage_protocol = iSCSI {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.target_helper = tgtadm {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.target_ip_address = 192.168.122.89 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.target_port = 3260 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.target_protocol = iscsi {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.trace_flags = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.unique_fqdn_network = True {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.use_chap_auth = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.volume_backend_name = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.volume_clear = zero {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.volume_clear_ionice = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.volume_clear_size = 0 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.volume_group = cinder-volumes {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_reports.file_event_handler = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_reports.log_dir = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.backend_availability_zone = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.backend_host = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.chap_password = **** {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.chap_username = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.chiscsi_conf = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.disk_geometry = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.driver_client_cert = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.driver_data_namespace = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.driver_use_ssl = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.extra_capabilities = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.filter_function = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.goodness_function = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.iser_helper = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.iser_ip_address = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.iser_port = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.iser_target_prefix = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.lvm_conf_file = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.lvm_mirrors = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.lvm_share_target = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.lvm_type = auto {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.num_shell_tries = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.nvmet_port_id = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.replication_device = **** {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.report_discard_supported = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.reserved_percentage = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.scst_target_driver = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.storage_protocol = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.target_helper = lioadm {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.target_ip_address = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.target_port = 3260 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.target_protocol = iscsi {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.trace_flags = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.use_chap_auth = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.volume_clear = zero {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.volume_clear_size = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] lvmdriver-1.volumes_dir = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_messaging_rabbit.ssl = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_messaging_rabbit.ssl_version = {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_messaging_notifications.driver = [] {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_messaging_notifications.retry = -1 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] oslo_messaging_notifications.transport_url = **** {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] key_manager.fixed_key = **** {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] barbican.barbican_api_version = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] barbican.barbican_endpoint = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] barbican.barbican_endpoint_type = public {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] barbican.barbican_region_name = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] barbican.cafile = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] barbican.certfile = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] barbican.collect_timing = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] barbican.insecure = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] barbican.keyfile = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] barbican.number_of_retries = 60 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] barbican.retry_delay = 1 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] barbican.send_service_user_token = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] barbican.split_loggers = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] barbican.timeout = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] barbican.verify_ssl = True {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] barbican.verify_ssl_path = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] barbican_service_user.auth_section = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] barbican_service_user.auth_type = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] barbican_service_user.cafile = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] barbican_service_user.certfile = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] barbican_service_user.collect_timing = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] barbican_service_user.insecure = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] barbican_service_user.keyfile = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] barbican_service_user.split_loggers = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] barbican_service_user.timeout = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] vault.approle_role_id = **** {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] vault.approle_secret_id = **** {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] vault.kv_mountpoint = secret {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] vault.kv_path = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] vault.kv_version = 2 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] vault.namespace = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] vault.root_token_id = **** {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] vault.ssl_ca_crt_file = None {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] vault.timeout = 60.0 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] vault.use_ssl = False {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:09:04 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] ******************************************************************************** {{(pid=75161) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Apr 28 19:09:04 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.955s {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:09:04 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:09:04 devstack sudo[75335]: pam_unix(sudo:session): session closed for user root Apr 28 19:09:04 devstack sudo[75549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 19:09:04 devstack sudo[75549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:09:05 devstack sudo[75549]: pam_unix(sudo:session): session closed for user root Apr 28 19:09:05 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.605s {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:09:05 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 19:09:05 devstack cinder-volume[75331]: INFO cinder.brick.local_dev.lvm [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 28 19:09:05 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:09:05 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:09:05 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:09:05 devstack sudo[75753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 28 19:09:05 devstack sudo[75753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:09:06 devstack sudo[75753]: pam_unix(sudo:session): session closed for user root Apr 28 19:09:06 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.682s {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:09:06 devstack cinder-volume[75331]: DEBUG cinder.brick.local_dev.lvm [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75331) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 28 19:09:06 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:09:06 devstack sudo[75904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 19:09:06 devstack sudo[75904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:09:07 devstack sudo[75904]: pam_unix(sudo:session): session closed for user root Apr 28 19:09:07 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.042s {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:09:07 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:09:07 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:09:07 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:09:07 devstack sudo[76084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 19:09:07 devstack sudo[76084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:09:08 devstack sudo[76084]: pam_unix(sudo:session): session closed for user root Apr 28 19:09:08 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.726s {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:09:08 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:09:08 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:09:08 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:09:08 devstack sudo[76116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 28 19:09:08 devstack sudo[76116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:09:08 devstack sudo[76116]: pam_unix(sudo:session): session closed for user root Apr 28 19:09:08 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.678s {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:09:08 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:09:08 devstack sudo[76126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 28 19:09:08 devstack sudo[76126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:09:09 devstack sudo[76126]: pam_unix(sudo:session): session closed for user root Apr 28 19:09:09 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.674s {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:09:09 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:09:09 devstack sudo[76133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 28 19:09:09 devstack sudo[76133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:09:10 devstack sudo[76133]: pam_unix(sudo:session): session closed for user root Apr 28 19:09:10 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.691s {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:09:10 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:09:10 devstack sudo[76138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 19:09:10 devstack sudo[76138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:09:10 devstack sudo[76138]: pam_unix(sudo:session): session closed for user root Apr 28 19:09:10 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.654s {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:09:10 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:09:10 devstack sudo[76143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 19:09:10 devstack sudo[76143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:09:11 devstack sudo[76143]: pam_unix(sudo:session): session closed for user root Apr 28 19:09:11 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.704s {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:09:11 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:09:11 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:09:11 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:09:11 devstack sudo[76149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 19:09:11 devstack sudo[76149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:09:12 devstack sudo[76149]: pam_unix(sudo:session): session closed for user root Apr 28 19:09:12 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.742s {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:09:12 devstack cinder-volume[75331]: INFO cinder.volume.drivers.lvm [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 28 19:09:12 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:09:12 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:09:12 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:09:12 devstack sudo[76159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 19:09:12 devstack sudo[76159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:09:13 devstack sudo[76159]: pam_unix(sudo:session): session closed for user root Apr 28 19:09:13 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.842s {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:09:13 devstack cinder-volume[75331]: DEBUG cinder.volume.drivers.lvm [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Updating volume stats {{(pid=75331) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 28 19:09:13 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:09:13 devstack sudo[76279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 28 19:09:13 devstack sudo[76279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:09:13 devstack sudo[76279]: pam_unix(sudo:session): session closed for user root Apr 28 19:09:13 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.616s {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:09:13 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:09:13 devstack sudo[76369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 19:09:13 devstack sudo[76369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:09:13 devstack cinder-volume[75161]: DEBUG dbcounter [-] [75161] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 19:09:14 devstack sudo[76369]: pam_unix(sudo:session): session closed for user root Apr 28 19:09:14 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.626s {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:09:14 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:09:14 devstack sudo[76425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 19:09:14 devstack sudo[76425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:09:14 devstack sudo[76425]: pam_unix(sudo:session): session closed for user root Apr 28 19:09:14 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.610s {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:09:14 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:09:14 devstack sudo[76431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 19:09:14 devstack sudo[76431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:09:15 devstack sudo[76431]: pam_unix(sudo:session): session closed for user root Apr 28 19:09:15 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.613s {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:09:15 devstack cinder-volume[75331]: INFO cinder.volume.driver [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Driver hasn't implemented _init_vendor_properties() Apr 28 19:09:15 devstack cinder-volume[75331]: DEBUG cinder.volume.driver [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75331) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 28 19:09:15 devstack cinder-volume[75331]: DEBUG oslo_db.sqlalchemy.engines [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75331) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 19:09:15 devstack cinder-volume[75331]: DEBUG dbcounter [-] [75331] Writer thread running {{(pid=75331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 28 19:09:15 devstack cinder-volume[75331]: DEBUG cinder.db.sqlalchemy.api [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Building query based on filter {{(pid=75331) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 28 19:09:15 devstack cinder-volume[75331]: DEBUG cinder.image.image_utils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75331) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 28 19:09:15 devstack cinder-volume[75331]: INFO cinder.keymgr.migration [None req-e536cc7a-15eb-4243-94e9-8d9b04cb966e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 28 19:09:15 devstack cinder-volume[75331]: DEBUG cinder.volume.drivers.lvm [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Updating volume stats {{(pid=75331) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 28 19:09:15 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:09:15 devstack sudo[76435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 28 19:09:15 devstack sudo[76435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:09:16 devstack sudo[76435]: pam_unix(sudo:session): session closed for user root Apr 28 19:09:16 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.606s {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:09:16 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:09:16 devstack sudo[76438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 19:09:16 devstack sudo[76438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:09:16 devstack sudo[76438]: pam_unix(sudo:session): session closed for user root Apr 28 19:09:16 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.674s {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:09:16 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:09:16 devstack sudo[76441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 19:09:16 devstack sudo[76441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:09:17 devstack sudo[76441]: pam_unix(sudo:session): session closed for user root Apr 28 19:09:17 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.626s {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:09:17 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:09:17 devstack sudo[76444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 19:09:17 devstack sudo[76444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:09:18 devstack sudo[76444]: pam_unix(sudo:session): session closed for user root Apr 28 19:09:18 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.636s {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:09:18 devstack cinder-volume[75331]: DEBUG cinder.manager [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Notifying Schedulers of capabilities ... {{(pid=75331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:09:18 devstack cinder-volume[75331]: INFO cinder.volume.manager [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Driver initialization completed successfully. Apr 28 19:09:18 devstack cinder-volume[75331]: INFO cinder.manager [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Initiating service 2 cleanup Apr 28 19:09:18 devstack cinder-volume[75331]: INFO cinder.manager [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Service 2 cleanup completed. Apr 28 19:09:18 devstack cinder-volume[75331]: DEBUG cinder.service [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Creating RPC server for service cinder-volume {{(pid=75331) start /opt/stack/cinder/cinder/service.py:231}} Apr 28 19:09:18 devstack cinder-volume[75331]: DEBUG cinder.service [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75331) start /opt/stack/cinder/cinder/service.py:237}} Apr 28 19:09:18 devstack cinder-volume[75331]: INFO cinder.volume.manager [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 28 19:09:18 devstack cinder-volume[75331]: DEBUG cinder.volume.drivers.lvm [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Updating volume stats {{(pid=75331) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 28 19:09:18 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:09:18 devstack sudo[76453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 28 19:09:18 devstack sudo[76453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:09:19 devstack sudo[76453]: pam_unix(sudo:session): session closed for user root Apr 28 19:09:19 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.637s {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:09:19 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:09:19 devstack sudo[76457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 19:09:19 devstack sudo[76457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:09:19 devstack sudo[76457]: pam_unix(sudo:session): session closed for user root Apr 28 19:09:19 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.626s {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:09:19 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:09:19 devstack sudo[76460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 19:09:19 devstack sudo[76460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:09:20 devstack sudo[76460]: pam_unix(sudo:session): session closed for user root Apr 28 19:09:20 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.597s {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:09:20 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:09:20 devstack sudo[76518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 19:09:20 devstack sudo[76518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:09:20 devstack sudo[76518]: pam_unix(sudo:session): session closed for user root Apr 28 19:09:20 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.586s {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:09:20 devstack cinder-volume[75331]: INFO cinder.volume.manager [None req-90decdf6-8e1f-4fa2-a4a8-3fb014e3fbe8 None None] Driver post RPC initialization completed successfully. Apr 28 19:09:30 devstack cinder-volume[75331]: DEBUG dbcounter [-] [75331] Writing DB stats cinder:SELECT=3 {{(pid=75331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 19:09:30 devstack cinder-volume[75331]: DEBUG dbcounter [-] [75331] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 19:10:50 devstack cinder-volume[75331]: DEBUG oslo_service.periodic_task [None req-6117dfa5-ad47-483e-9d6d-55d2436e65a4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 28 19:10:50 devstack cinder-volume[75331]: DEBUG cinder.volume.drivers.lvm [None req-6117dfa5-ad47-483e-9d6d-55d2436e65a4 None None] Updating volume stats {{(pid=75331) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 28 19:10:50 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-6117dfa5-ad47-483e-9d6d-55d2436e65a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:10:50 devstack sudo[81249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 28 19:10:50 devstack sudo[81249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:10:51 devstack sudo[81249]: pam_unix(sudo:session): session closed for user root Apr 28 19:10:51 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-6117dfa5-ad47-483e-9d6d-55d2436e65a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.572s {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:10:51 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-6117dfa5-ad47-483e-9d6d-55d2436e65a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:10:51 devstack sudo[81253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 19:10:51 devstack sudo[81253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:10:52 devstack sudo[81253]: pam_unix(sudo:session): session closed for user root Apr 28 19:10:52 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-6117dfa5-ad47-483e-9d6d-55d2436e65a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.596s {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:10:52 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-6117dfa5-ad47-483e-9d6d-55d2436e65a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:10:52 devstack sudo[81257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 19:10:52 devstack sudo[81257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:10:52 devstack sudo[81257]: pam_unix(sudo:session): session closed for user root Apr 28 19:10:52 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-6117dfa5-ad47-483e-9d6d-55d2436e65a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.586s {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:10:52 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-6117dfa5-ad47-483e-9d6d-55d2436e65a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:10:52 devstack sudo[81260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 19:10:52 devstack sudo[81260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:10:53 devstack sudo[81260]: pam_unix(sudo:session): session closed for user root Apr 28 19:10:53 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-6117dfa5-ad47-483e-9d6d-55d2436e65a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.615s {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:10:53 devstack cinder-volume[75331]: DEBUG cinder.manager [None req-6117dfa5-ad47-483e-9d6d-55d2436e65a4 None None] Notifying Schedulers of capabilities ... {{(pid=75331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:11:30 devstack cinder-volume[75331]: DEBUG dbcounter [-] [75331] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 19:11:50 devstack cinder-volume[75331]: DEBUG oslo_service.periodic_task [None req-6117dfa5-ad47-483e-9d6d-55d2436e65a4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 28 19:11:50 devstack cinder-volume[75331]: DEBUG cinder.volume.drivers.lvm [None req-6117dfa5-ad47-483e-9d6d-55d2436e65a4 None None] Updating volume stats {{(pid=75331) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 28 19:11:50 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-6117dfa5-ad47-483e-9d6d-55d2436e65a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:11:50 devstack sudo[81761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 28 19:11:50 devstack sudo[81761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:11:51 devstack sudo[81761]: pam_unix(sudo:session): session closed for user root Apr 28 19:11:51 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-6117dfa5-ad47-483e-9d6d-55d2436e65a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.601s {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:11:51 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-6117dfa5-ad47-483e-9d6d-55d2436e65a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:11:51 devstack sudo[81764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 19:11:51 devstack sudo[81764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:11:52 devstack sudo[81764]: pam_unix(sudo:session): session closed for user root Apr 28 19:11:52 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-6117dfa5-ad47-483e-9d6d-55d2436e65a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.568s {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:11:52 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-6117dfa5-ad47-483e-9d6d-55d2436e65a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:11:52 devstack sudo[81767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 19:11:52 devstack sudo[81767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:11:52 devstack sudo[81767]: pam_unix(sudo:session): session closed for user root Apr 28 19:11:52 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-6117dfa5-ad47-483e-9d6d-55d2436e65a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.612s {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:11:52 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-6117dfa5-ad47-483e-9d6d-55d2436e65a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:11:52 devstack sudo[81771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 19:11:52 devstack sudo[81771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:11:53 devstack sudo[81771]: pam_unix(sudo:session): session closed for user root Apr 28 19:11:53 devstack cinder-volume[75331]: DEBUG oslo_concurrency.processutils [None req-6117dfa5-ad47-483e-9d6d-55d2436e65a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.631s {{(pid=75331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:11:53 devstack cinder-volume[75331]: DEBUG cinder.manager [None req-6117dfa5-ad47-483e-9d6d-55d2436e65a4 None None] Notifying Schedulers of capabilities ... {{(pid=75331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:12:07 devstack cinder-volume[75161]: INFO oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] Caught SIGTERM, stopping children Apr 28 19:12:07 devstack cinder-volume[75161]: DEBUG oslo_concurrency.lockutils [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] Acquiring lock "singleton_lock" {{(pid=75161) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 28 19:12:07 devstack cinder-volume[75161]: DEBUG oslo_concurrency.lockutils [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] Acquired lock "singleton_lock" {{(pid=75161) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 28 19:12:07 devstack cinder-volume[75161]: DEBUG oslo_concurrency.lockutils [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] Releasing lock "singleton_lock" {{(pid=75161) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 28 19:12:07 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] Stop services. {{(pid=75161) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 28 19:12:07 devstack cinder-volume[75161]: DEBUG oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] Killing children. {{(pid=75161) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 28 19:12:07 devstack cinder-volume[75161]: INFO oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] Waiting on 1 children to exit Apr 28 19:12:08 devstack cinder-volume[75331]: DEBUG oslo_concurrency.lockutils [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] Acquiring lock "singleton_lock" {{(pid=75331) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 28 19:12:08 devstack cinder-volume[75331]: DEBUG oslo_concurrency.lockutils [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] Acquired lock "singleton_lock" {{(pid=75331) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 28 19:12:08 devstack cinder-volume[75331]: DEBUG oslo_concurrency.lockutils [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] Releasing lock "singleton_lock" {{(pid=75331) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 28 19:12:08 devstack cinder-volume[75331]: WARNING amqp [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 28 19:12:08 devstack cinder-volume[75331]: WARNING amqp [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 28 19:12:08 devstack cinder-volume[75161]: INFO oslo_service.backend._eventlet.service [None req-9fc3d6eb-1d67-4bac-ab84-1c5d84b0e3ad None None] Child 75331 exited with status 0 Apr 28 19:12:10 devstack cinder-volume[82993]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82993) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 28 19:12:10 devstack cinder-volume[82993]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82993) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 28 19:12:10 devstack cinder-volume[82993]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82993) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 28 19:12:11 devstack cinder-volume[82993]: INFO dbcounter [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] Registered counter for database cinder Apr 28 19:12:11 devstack cinder-volume[82993]: DEBUG oslo_db.sqlalchemy.engines [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82993) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 19:12:11 devstack cinder-volume[82993]: DEBUG dbcounter [-] [82993] Writer thread running {{(pid=82993) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 28 19:12:11 devstack cinder-volume[82993]: INFO cinder.rpc [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 28 19:12:11 devstack cinder-volume[82993]: INFO cinder.rpc [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 28 19:12:11 devstack cinder-volume[82993]: DEBUG oslo_db.sqlalchemy.engines [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82993) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 19:12:12 devstack cinder-volume[82993]: INFO cinder.volume.manager [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] Determined volume DB was empty at startup. Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG cinder.volume.manager [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82993) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 28 19:12:12 devstack cinder-volume[82993]: INFO cinder.volume.manager [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 28 19:12:12 devstack cinder-volume[82993]: WARNING stevedore.named [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 28 19:12:12 devstack cinder-volume[82993]: WARNING castellan.key_manager [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 28 19:12:12 devstack cinder-volume[82993]: WARNING cinder.keymgr.conf_key_mgr [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 28 19:12:12 devstack cinder-volume[82993]: INFO cinder.volume.manager [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_db.sqlalchemy.engines [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82993) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 19:12:12 devstack cinder-volume[82993]: INFO oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] Starting 1 workers Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] Started child 83275 {{(pid=82993) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] Full set of CONF: {{(pid=82993) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] ******************************************************************************** {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] Configuration options gathered from: {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Apr 28 19:12:12 devstack cinder-volume[83275]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0) Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] ================================================================================ {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] allow_availability_zone_fallback = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] allow_compression_on_image_upload = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] allowed_direct_url_schemes = [] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] api_rate_limit = True {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] auth_strategy = keystone {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_availability_zone = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_host = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_name = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_stats_polling_interval = 60 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backup_api_class = cinder.backup.api.API {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backup_name_template = backup-%s {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backup_use_same_host = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backup_use_temp_snapshot = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] chap_password = **** {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] chap_username = {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] cinder_internal_tenant_project_id = 01521d64056246c4a245e5f872643f6c {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] cinder_internal_tenant_user_id = 5cbefb6a41534ec082ace1a270e6689c {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] cluster = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] compression_format = gzip {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] compute_api_class = cinder.compute.nova.API {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] config_dir = [] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] config_source = [] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] control_exchange = openstack {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] debug = True {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] default_availability_zone = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] default_group_type = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] default_volume_type = QuobyteHD {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] disk_geometry = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] driver_client_cert = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] driver_client_cert_key = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] driver_data_namespace = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] driver_ssl_cert_path = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] driver_ssl_cert_verify = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] driver_use_ssl = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[83275]: INFO cinder.volume.manager [None req-9ffcfb52-b6e5-4a56-a948-9f80f64c8588 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 28 19:12:12 devstack cinder-volume[83275]: DEBUG cinder.volume.drivers.remotefs [None req-9ffcfb52-b6e5-4a56-a948-9f80f64c8588 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83275) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] enable_new_services = True {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] enable_unsupported_driver = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] enabled_backends = ['QuobyteHD'] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] enforce_multipath_for_image_xfer = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] filter_function = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] glance_api_insecure = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] glance_api_servers = ['http://192.168.122.89/image'] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] glance_api_ssl_compression = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] glance_ca_certificates_file = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] glance_catalog_info = image:glance:publicURL {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] glance_certfile = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] glance_keyfile = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] glance_num_retries = 3 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] glance_request_timeout = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] goodness_function = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] graceful_shutdown_timeout = 5 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] group_api_class = cinder.group.api.API {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] host = devstack {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] image_compress_on_upload = True {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] image_conversion_address_space_limit = 1 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] image_conversion_cpu_limit = 60 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] image_conversion_disable = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] image_upload_use_cinder_backend = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] image_upload_use_internal_tenant = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] image_volume_cache_enabled = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] image_volume_cache_max_count = 0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] image_volume_cache_max_size_gb = 0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] init_host_max_objects_retrieval = 0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] instance_format = [instance: %(uuid)s] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] iscsi_target_flags = {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] iscsi_write_cache = on {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] iser_helper = tgtadm {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] iser_ip_address = 192.168.122.89 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] iser_port = 3260 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] log_color = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] log_config_append = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] log_dir = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] log_file = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] log_options = True {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] log_rotate_interval = 1 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] log_rotate_interval_type = days {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] log_rotation_type = none {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] max_age = 0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] max_logfile_count = 30 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] max_logfile_size_mb = 200 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] max_over_subscription_ratio = 20.0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] message_reap_interval = 86400 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] message_ttl = 2592000 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] migration_create_volume_timeout_secs = 300 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] monkey_patch = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] monkey_patch_modules = [] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] my_ip = 192.168.122.89 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] no_snapshot_gb_quota = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] num_iser_scan_tries = 3 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] num_shell_tries = 3 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] num_volume_device_scan_tries = 3 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] nvmeof_conn_info_version = 1 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] nvmet_ns_id = 10 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] nvmet_port_id = 1 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] osapi_max_limit = 1000 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] osapi_volume_ext_list = [] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] osapi_volume_listen_port = 8776 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] osapi_volume_use_ssl = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] osapi_volume_workers = 2 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] per_volume_size_limit = -1 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] periodic_fuzzy_delay = 60 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] periodic_interval = 60 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] public_endpoint = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] publish_errors = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] quota_backup_gigabytes = 1000 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] quota_backups = 10 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] quota_gigabytes = 1000 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] quota_groups = 10 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] quota_snapshots = 10 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] quota_volumes = 10 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] rate_limit_burst = 0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] rate_limit_except_level = CRITICAL {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] rate_limit_interval = 0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] reinit_driver_count = 3 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] replication_device = **** {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] report_discard_supported = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] report_interval = 120 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] reservation_clean_interval = 86400 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] reservation_expire = 86400 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] reserved_image_namespaces = [] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] reserved_percentage = 0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] rpc_response_timeout = 120 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] run_external_periodic_tasks = True {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] scst_target_driver = iscsi {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] scst_target_iqn_name = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] service_down_time = 720 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] shell_completion = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] snapshot_name_template = snapshot-%s {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] split_loggers = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] state_path = /opt/stack/data/cinder {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] storage_availability_zone = nova {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] storage_protocol = iSCSI {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] syslog_log_facility = LOG_USER {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] target_helper = lioadm {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] target_ip_address = 192.168.122.89 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] target_port = 3260 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] target_protocol = iscsi {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[83275]: DEBUG cinder.volume.drivers.quobyte [None req-9ffcfb52-b6e5-4a56-a948-9f80f64c8588 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83275) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 28 19:12:12 devstack cinder-volume[83275]: WARNING cinder.volume.drivers.quobyte [None req-9ffcfb52-b6e5-4a56-a948-9f80f64c8588 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 28 19:12:12 devstack cinder-volume[83275]: WARNING cinder.volume.drivers.quobyte [None req-9ffcfb52-b6e5-4a56-a948-9f80f64c8588 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] target_secondary_ip_addresses = [] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] trace_flags = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] transport_url = **** {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] until_refresh = 0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] use_chap_auth = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] use_default_quota_class = True {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] use_journal = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] use_json = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[83275]: DEBUG oslo_concurrency.processutils [None req-9ffcfb52-b6e5-4a56-a948-9f80f64c8588 None None] Running cmd (subprocess): mount.quobyte {{(pid=83275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] use_multipath_for_image_xfer = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] use_stderr = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] use_syslog = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] verify_glance_signatures = enabled {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] volume_api_class = cinder.volume.api.API {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] volume_backend_name = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] volume_clear = zero {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] volume_clear_ionice = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] volume_clear_size = 0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] volume_copy_bps_limit = 0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] volume_dd_blocksize = 1M {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] volume_name_template = volume-%s {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] volume_service_inithost_offload = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] volume_usage_audit_period = month {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] zoning_mode = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_concurrency.disable_process_locking = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] keystone_authtoken.admin_password = **** {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] keystone_authtoken.admin_token = **** {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] keystone_authtoken.admin_user = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] keystone_authtoken.auth_port = 35357 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] keystone_authtoken.auth_protocol = https {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] keystone_authtoken.auth_section = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] keystone_authtoken.auth_type = password {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] keystone_authtoken.auth_uri = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] keystone_authtoken.auth_version = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] keystone_authtoken.cache = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] keystone_authtoken.certfile = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] keystone_authtoken.identity_uri = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] keystone_authtoken.include_service_catalog = True {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] keystone_authtoken.insecure = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] keystone_authtoken.interface = public {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] keystone_authtoken.keyfile = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] keystone_authtoken.memcache_password = {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] keystone_authtoken.memcache_username = {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] keystone_authtoken.region_name = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] keystone_authtoken.service_type = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.89/identity {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] cache.backend = dogpile.cache.null {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] cache.backend_argument = **** {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] cache.backend_expiration_time = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] cache.config_prefix = cache.oslo {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] cache.debug_cache_backend = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] cache.enable_retry_client = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] cache.enable_socket_keepalive = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] cache.enabled = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] cache.enforce_fips_mode = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] cache.expiration_time = 600 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] cache.hashclient_retry_attempts = 2 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] cache.memcache_dead_retry = 300 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] cache.memcache_pool_maxsize = 10 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] cache.memcache_sasl_enabled = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] cache.password = **** {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] cache.proxies = [] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] cache.redis_db = 0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] cache.redis_server = localhost:6379 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] cache.retry_attempts = 2 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] cache.retry_delay = 0.0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] cache.socket_keepalive_count = 1 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] cache.socket_keepalive_idle = 1 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] cache.socket_keepalive_interval = 1 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] cache.socket_timeout = 1.0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] cache.tls_allowed_ciphers = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] cache.tls_cafile = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] cache.tls_certfile = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] cache.tls_enabled = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] cache.tls_keyfile = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] cache.username = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] coordination.backend_url = **** {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] database.asyncio_connection = **** {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] database.asyncio_slave_connection = **** {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] database.backend = sqlalchemy {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] database.connection = **** {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] database.connection_debug = 0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] database.connection_parameters = {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] database.connection_recycle_time = 3600 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] database.connection_trace = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] database.db_inc_retry_interval = True {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] database.db_max_retries = 20 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] database.db_max_retry_interval = 10 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] database.db_retry_interval = 1 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] database.max_overflow = 50 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] database.max_pool_size = 5 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] database.max_retries = 10 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] database.mysql_wsrep_sync_wait = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] database.pool_timeout = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] database.retry_interval = 10 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] database.slave_connection = **** {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] database.sqlite_synchronous = True {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] database.synchronous_reader = True {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] database.use_db_reconnect = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] profiler.connection_string = messaging:// {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] profiler.enabled = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] profiler.es_doc_type = notification {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] profiler.es_scroll_size = 10000 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] profiler.es_scroll_time = 2m {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] profiler.filter_error_trace = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] profiler.hmac_keys = **** {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] profiler.sentinel_service_name = mymaster {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] profiler.socket_timeout = 0.1 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] profiler.trace_requests = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] profiler.trace_sqlalchemy = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] profiler_jaeger.process_tags = {} {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] profiler_jaeger.service_name_prefix = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] profiler_otlp.service_name_prefix = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_policy.enforce_new_defaults = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: WARNING oslo_config.cfg [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_policy.enforce_scope = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_policy.policy_default_rule = default {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_policy.policy_file = policy.yaml {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] privsep_osbrick.group = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] privsep_osbrick.helper_command = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] privsep_osbrick.user = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] cinder_sys_admin.group = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] cinder_sys_admin.helper_command = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] cinder_sys_admin.user = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] service_user.auth_section = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] service_user.auth_type = password {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] service_user.cafile = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] service_user.certfile = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] service_user.collect_timing = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] service_user.insecure = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] service_user.keyfile = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] service_user.send_service_user_token = True {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] service_user.split_loggers = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] service_user.timeout = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] glance.auth_section = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] glance.auth_type = password {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] glance.certfile = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] glance.collect_timing = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] glance.insecure = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] glance.keyfile = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] glance.region_name = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] glance.split_loggers = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] glance.timeout = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.backend_availability_zone = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.chap_password = **** {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.chap_username = {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.disk_geometry = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.driver_client_cert = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.driver_client_cert_key = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.driver_data_namespace = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.driver_use_ssl = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.extra_capabilities = {} {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.filter_function = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.goodness_function = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.iscsi_target_flags = {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.iscsi_write_cache = on {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.iser_helper = tgtadm {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.iser_ip_address = 192.168.122.89 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.iser_port = 3260 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.nas_host = {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.nas_login = admin {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.nas_mount_options = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.nas_password = **** {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.nas_private_key = {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.nas_share_path = {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.num_shell_tries = 3 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.quobyte_volume_url = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.replication_device = **** {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.report_discard_supported = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.reserved_percentage = 0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.target_helper = tgtadm {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.target_ip_address = 192.168.122.89 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.target_port = 3260 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.target_protocol = iscsi {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.trace_flags = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.unique_fqdn_network = True {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.use_chap_auth = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.volume_backend_name = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.volume_clear = zero {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.volume_clear_ionice = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.volume_clear_size = 0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_reports.file_event_handler = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_reports.log_dir = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.backend_availability_zone = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.backend_host = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.chap_password = **** {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.chap_username = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.chiscsi_conf = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.disk_geometry = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.driver_client_cert = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.driver_data_namespace = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.driver_use_ssl = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.extra_capabilities = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.filter_function = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.goodness_function = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.iser_helper = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.iser_ip_address = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.iser_port = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.iser_target_prefix = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.nas_host = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.nas_login = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.nas_mount_options = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.nas_password = **** {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.nas_private_key = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.nas_share_path = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.nas_ssh_port = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.num_shell_tries = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.nvmet_port_id = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.replication_device = **** {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.report_discard_supported = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.reserved_percentage = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.scst_target_driver = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.storage_protocol = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.target_helper = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.target_ip_address = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.target_port = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.target_prefix = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.target_protocol = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.trace_flags = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.use_chap_auth = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.volume_clear = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.volume_clear_size = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] QuobyteHD.volumes_dir = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_messaging_rabbit.ssl = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_messaging_notifications.driver = [] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_messaging_notifications.retry = -1 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] key_manager.fixed_key = **** {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] barbican.barbican_api_version = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] barbican.barbican_endpoint = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] barbican.barbican_endpoint_type = public {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] barbican.barbican_region_name = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] barbican.cafile = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] barbican.certfile = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] barbican.collect_timing = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] barbican.insecure = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] barbican.keyfile = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] barbican.number_of_retries = 60 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] barbican.retry_delay = 1 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] barbican.send_service_user_token = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] barbican.split_loggers = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack quobyte-client[83277]: Reading configuration file: /etc/quobyte/client.cfg Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] barbican.timeout = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] barbican.verify_ssl = True {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] barbican.verify_ssl_path = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] barbican_service_user.auth_section = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] barbican_service_user.auth_type = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] barbican_service_user.cafile = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack quobyte-client[83277]: Invalid parameters found, error: missing mount point. Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] barbican_service_user.certfile = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] barbican_service_user.collect_timing = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] barbican_service_user.insecure = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] barbican_service_user.keyfile = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] barbican_service_user.split_loggers = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] barbican_service_user.timeout = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] vault.approle_role_id = **** {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack quobyte-client[83277]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] vault.approle_secret_id = **** {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] vault.kv_mountpoint = secret {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] vault.kv_path = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] vault.kv_version = 2 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] vault.namespace = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] vault.root_token_id = **** {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] vault.ssl_ca_crt_file = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack quobyte-client[83277]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] vault.timeout = 60.0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] vault.use_ssl = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:12 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] ******************************************************************************** {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Apr 28 19:12:12 devstack cinder-volume[83275]: DEBUG oslo_concurrency.processutils [None req-9ffcfb52-b6e5-4a56-a948-9f80f64c8588 None None] CMD "mount.quobyte" returned: 1 in 0.226s {{(pid=83275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:12:12 devstack cinder-volume[83275]: DEBUG oslo_concurrency.lockutils [None req-9ffcfb52-b6e5-4a56-a948-9f80f64c8588 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83275) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:12:12 devstack cinder-volume[83275]: DEBUG oslo_concurrency.lockutils [None req-9ffcfb52-b6e5-4a56-a948-9f80f64c8588 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83275) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:12:12 devstack cinder-volume[83275]: DEBUG cinder.volume.drivers.quobyte [None req-9ffcfb52-b6e5-4a56-a948-9f80f64c8588 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83275) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:12:12 devstack cinder-volume[83275]: INFO cinder.volume.drivers.quobyte [None req-9ffcfb52-b6e5-4a56-a948-9f80f64c8588 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd ... Apr 28 19:12:12 devstack cinder-volume[83275]: DEBUG oslo_concurrency.processutils [None req-9ffcfb52-b6e5-4a56-a948-9f80f64c8588 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c -c /etc/quobyte/client-cinder.cfg {{(pid=83275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:12:12 devstack sudo[83282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c -c /etc/quobyte/client-cinder.cfg Apr 28 19:12:12 devstack sudo[83282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:12:13 devstack sudo[83282]: pam_unix(sudo:session): session closed for user root Apr 28 19:12:13 devstack cinder-volume[83275]: DEBUG oslo_concurrency.processutils [None req-9ffcfb52-b6e5-4a56-a948-9f80f64c8588 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.823s {{(pid=83275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:12:13 devstack cinder-volume[83275]: INFO cinder.volume.drivers.quobyte [None req-9ffcfb52-b6e5-4a56-a948-9f80f64c8588 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd succeeded Apr 28 19:12:13 devstack cinder-volume[83275]: DEBUG cinder.volume.drivers.quobyte [None req-9ffcfb52-b6e5-4a56-a948-9f80f64c8588 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83275) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:12:13 devstack cinder-volume[83275]: DEBUG oslo_concurrency.lockutils [None req-9ffcfb52-b6e5-4a56-a948-9f80f64c8588 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.848s {{(pid=83275) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:12:13 devstack cinder-volume[83275]: DEBUG oslo_concurrency.processutils [None req-9ffcfb52-b6e5-4a56-a948-9f80f64c8588 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:12:13 devstack sudo[83367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:12:13 devstack sudo[83367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:12:14 devstack sudo[83367]: pam_unix(sudo:session): session closed for user root Apr 28 19:12:14 devstack cinder-volume[83275]: DEBUG oslo_concurrency.processutils [None req-9ffcfb52-b6e5-4a56-a948-9f80f64c8588 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.623s {{(pid=83275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:12:14 devstack cinder-volume[83275]: INFO cinder.volume.driver [None req-9ffcfb52-b6e5-4a56-a948-9f80f64c8588 None None] Driver hasn't implemented _init_vendor_properties() Apr 28 19:12:14 devstack cinder-volume[83275]: DEBUG cinder.volume.driver [None req-9ffcfb52-b6e5-4a56-a948-9f80f64c8588 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6508674621582, 'free_capacity_gb': 1775.6508674621582, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83275) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 28 19:12:14 devstack cinder-volume[83275]: DEBUG oslo_db.sqlalchemy.engines [None req-9ffcfb52-b6e5-4a56-a948-9f80f64c8588 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83275) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 19:12:14 devstack cinder-volume[83275]: DEBUG dbcounter [-] [83275] Writer thread running {{(pid=83275) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 28 19:12:14 devstack cinder-volume[83275]: DEBUG cinder.db.sqlalchemy.api [None req-9ffcfb52-b6e5-4a56-a948-9f80f64c8588 None None] Building query based on filter {{(pid=83275) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 28 19:12:14 devstack cinder-volume[83275]: DEBUG cinder.image.image_utils [None req-9ffcfb52-b6e5-4a56-a948-9f80f64c8588 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83275) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 28 19:12:14 devstack cinder-volume[83275]: INFO cinder.keymgr.migration [None req-d215c1c6-2ec6-4523-a061-c41ae8e93dde None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 28 19:12:14 devstack cinder-volume[83275]: DEBUG oslo_concurrency.lockutils [None req-9ffcfb52-b6e5-4a56-a948-9f80f64c8588 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83275) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:12:14 devstack cinder-volume[83275]: DEBUG oslo_concurrency.lockutils [None req-9ffcfb52-b6e5-4a56-a948-9f80f64c8588 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83275) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:12:14 devstack cinder-volume[83275]: DEBUG cinder.volume.drivers.quobyte [None req-9ffcfb52-b6e5-4a56-a948-9f80f64c8588 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83275) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:12:14 devstack cinder-volume[83275]: DEBUG cinder.volume.drivers.quobyte [None req-9ffcfb52-b6e5-4a56-a948-9f80f64c8588 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83275) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:12:14 devstack cinder-volume[83275]: DEBUG oslo_concurrency.lockutils [None req-9ffcfb52-b6e5-4a56-a948-9f80f64c8588 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83275) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:12:14 devstack cinder-volume[83275]: DEBUG oslo_concurrency.processutils [None req-9ffcfb52-b6e5-4a56-a948-9f80f64c8588 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:12:14 devstack sudo[83390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:12:14 devstack sudo[83390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:12:15 devstack sudo[83390]: pam_unix(sudo:session): session closed for user root Apr 28 19:12:15 devstack cinder-volume[83275]: DEBUG oslo_concurrency.processutils [None req-9ffcfb52-b6e5-4a56-a948-9f80f64c8588 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.618s {{(pid=83275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:12:15 devstack cinder-volume[83275]: DEBUG cinder.manager [None req-9ffcfb52-b6e5-4a56-a948-9f80f64c8588 None None] Notifying Schedulers of capabilities ... {{(pid=83275) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:12:15 devstack cinder-volume[83275]: INFO cinder.volume.manager [None req-9ffcfb52-b6e5-4a56-a948-9f80f64c8588 None None] Driver initialization completed successfully. Apr 28 19:12:15 devstack cinder-volume[83275]: INFO cinder.manager [None req-9ffcfb52-b6e5-4a56-a948-9f80f64c8588 None None] Initiating service 3 cleanup Apr 28 19:12:15 devstack cinder-volume[83275]: INFO cinder.manager [None req-9ffcfb52-b6e5-4a56-a948-9f80f64c8588 None None] Service 3 cleanup completed. Apr 28 19:12:15 devstack cinder-volume[83275]: DEBUG cinder.service [None req-9ffcfb52-b6e5-4a56-a948-9f80f64c8588 None None] Creating RPC server for service cinder-volume {{(pid=83275) start /opt/stack/cinder/cinder/service.py:231}} Apr 28 19:12:15 devstack cinder-volume[83275]: DEBUG cinder.service [None req-9ffcfb52-b6e5-4a56-a948-9f80f64c8588 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83275) start /opt/stack/cinder/cinder/service.py:237}} Apr 28 19:12:15 devstack cinder-volume[83275]: INFO cinder.volume.manager [None req-9ffcfb52-b6e5-4a56-a948-9f80f64c8588 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 28 19:12:15 devstack cinder-volume[83275]: DEBUG oslo_concurrency.lockutils [None req-9ffcfb52-b6e5-4a56-a948-9f80f64c8588 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83275) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:12:15 devstack cinder-volume[83275]: DEBUG oslo_concurrency.lockutils [None req-9ffcfb52-b6e5-4a56-a948-9f80f64c8588 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83275) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:12:15 devstack cinder-volume[83275]: DEBUG cinder.volume.drivers.quobyte [None req-9ffcfb52-b6e5-4a56-a948-9f80f64c8588 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83275) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:12:15 devstack cinder-volume[83275]: DEBUG cinder.volume.drivers.quobyte [None req-9ffcfb52-b6e5-4a56-a948-9f80f64c8588 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83275) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:12:15 devstack cinder-volume[83275]: DEBUG oslo_concurrency.lockutils [None req-9ffcfb52-b6e5-4a56-a948-9f80f64c8588 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83275) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:12:15 devstack cinder-volume[83275]: DEBUG oslo_concurrency.processutils [None req-9ffcfb52-b6e5-4a56-a948-9f80f64c8588 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:12:15 devstack sudo[83412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:12:15 devstack sudo[83412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:12:16 devstack sudo[83412]: pam_unix(sudo:session): session closed for user root Apr 28 19:12:16 devstack cinder-volume[83275]: DEBUG oslo_concurrency.processutils [None req-9ffcfb52-b6e5-4a56-a948-9f80f64c8588 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.790s {{(pid=83275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:12:16 devstack cinder-volume[83275]: INFO cinder.volume.manager [None req-9ffcfb52-b6e5-4a56-a948-9f80f64c8588 None None] Driver post RPC initialization completed successfully. Apr 28 19:12:18 devstack cinder-volume[82993]: INFO oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] Caught SIGTERM, stopping children Apr 28 19:12:18 devstack cinder-volume[82993]: DEBUG oslo_concurrency.lockutils [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] Acquiring lock "singleton_lock" {{(pid=82993) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 28 19:12:18 devstack cinder-volume[82993]: DEBUG oslo_concurrency.lockutils [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] Acquired lock "singleton_lock" {{(pid=82993) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 28 19:12:18 devstack cinder-volume[82993]: DEBUG oslo_concurrency.lockutils [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] Releasing lock "singleton_lock" {{(pid=82993) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 28 19:12:18 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] Stop services. {{(pid=82993) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 28 19:12:18 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] Killing children. {{(pid=82993) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 28 19:12:18 devstack cinder-volume[82993]: INFO oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] Waiting on 1 children to exit Apr 28 19:12:19 devstack cinder-volume[83275]: DEBUG oslo_concurrency.lockutils [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] Acquiring lock "singleton_lock" {{(pid=83275) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 28 19:12:19 devstack cinder-volume[83275]: DEBUG oslo_concurrency.lockutils [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] Acquired lock "singleton_lock" {{(pid=83275) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 28 19:12:19 devstack cinder-volume[83275]: DEBUG oslo_concurrency.lockutils [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] Releasing lock "singleton_lock" {{(pid=83275) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 28 19:12:19 devstack cinder-volume[83275]: WARNING amqp [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 28 19:12:19 devstack cinder-volume[83275]: WARNING amqp [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 28 19:12:19 devstack cinder-volume[82993]: INFO oslo_service.backend._eventlet.service [None req-ffbbbf06-2cca-4daf-a19c-52f62e6a56b7 None None] Child 83275 exited with status 0 Apr 28 19:12:22 devstack cinder-volume[83621]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83621) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 28 19:12:22 devstack cinder-volume[83621]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83621) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 28 19:12:22 devstack cinder-volume[83621]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83621) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 28 19:12:24 devstack cinder-volume[83621]: INFO dbcounter [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] Registered counter for database cinder Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_db.sqlalchemy.engines [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83621) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG dbcounter [-] [83621] Writer thread running {{(pid=83621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 28 19:12:24 devstack cinder-volume[83621]: INFO cinder.rpc [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 28 19:12:24 devstack cinder-volume[83621]: INFO cinder.rpc [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_db.sqlalchemy.engines [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83621) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 19:12:24 devstack cinder-volume[83621]: INFO cinder.volume.manager [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] Determined volume DB was empty at startup. Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG cinder.volume.manager [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83621) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 28 19:12:24 devstack cinder-volume[83621]: WARNING stevedore.named [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 28 19:12:24 devstack cinder-volume[83621]: WARNING castellan.key_manager [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 28 19:12:24 devstack cinder-volume[83621]: WARNING cinder.keymgr.conf_key_mgr [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 28 19:12:24 devstack cinder-volume[83621]: INFO cinder.volume.manager [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_db.sqlalchemy.engines [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83621) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 19:12:24 devstack cinder-volume[83621]: INFO oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] Starting 1 workers Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] Started child 83863 {{(pid=83621) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] Full set of CONF: {{(pid=83621) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] ******************************************************************************** {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] Configuration options gathered from: {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] ================================================================================ {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] allow_availability_zone_fallback = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] allow_compression_on_image_upload = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] allowed_direct_url_schemes = [] {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] api_rate_limit = True {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] auth_strategy = keystone {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_availability_zone = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_host = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_name = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_stats_polling_interval = 60 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backup_api_class = cinder.backup.api.API {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backup_name_template = backup-%s {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83863]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0) Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backup_use_same_host = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backup_use_temp_snapshot = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] chap_password = **** {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] chap_username = {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] cinder_internal_tenant_project_id = 01521d64056246c4a245e5f872643f6c {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] cinder_internal_tenant_user_id = 5cbefb6a41534ec082ace1a270e6689c {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] cluster = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] compression_format = gzip {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] compute_api_class = cinder.compute.nova.API {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] config_dir = [] {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] config_source = [] {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] control_exchange = openstack {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] debug = True {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] default_availability_zone = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] default_group_type = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] default_volume_type = QuobyteHD {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] disk_geometry = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] driver_client_cert = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] driver_client_cert_key = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] driver_data_namespace = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] driver_ssl_cert_path = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] driver_ssl_cert_verify = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] driver_use_ssl = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] enable_new_services = True {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] enable_unsupported_driver = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] enabled_backends = ['QuobyteHD'] {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] enforce_multipath_for_image_xfer = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] filter_function = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] glance_api_insecure = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] glance_api_servers = ['http://192.168.122.89/image'] {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] glance_api_ssl_compression = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] glance_ca_certificates_file = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] glance_catalog_info = image:glance:publicURL {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] glance_certfile = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] glance_keyfile = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] glance_num_retries = 3 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] glance_request_timeout = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] goodness_function = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] graceful_shutdown_timeout = 5 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] group_api_class = cinder.group.api.API {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] host = devstack {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] image_compress_on_upload = True {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] image_conversion_address_space_limit = 1 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] image_conversion_cpu_limit = 60 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] image_conversion_disable = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] image_upload_use_cinder_backend = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] image_upload_use_internal_tenant = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] image_volume_cache_enabled = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] image_volume_cache_max_count = 0 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] image_volume_cache_max_size_gb = 0 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] init_host_max_objects_retrieval = 0 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] instance_format = [instance: %(uuid)s] {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] iscsi_target_flags = {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] iscsi_write_cache = on {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] iser_helper = tgtadm {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] iser_ip_address = 192.168.122.89 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] iser_port = 3260 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] log_color = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] log_config_append = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] log_dir = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] log_file = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] log_options = True {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] log_rotate_interval = 1 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] log_rotate_interval_type = days {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] log_rotation_type = none {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] max_age = 0 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] max_logfile_count = 30 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] max_logfile_size_mb = 200 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] max_over_subscription_ratio = 20.0 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] message_reap_interval = 86400 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] message_ttl = 2592000 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] migration_create_volume_timeout_secs = 300 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] monkey_patch = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] monkey_patch_modules = [] {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] my_ip = 192.168.122.89 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] no_snapshot_gb_quota = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] num_iser_scan_tries = 3 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] num_shell_tries = 3 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] num_volume_device_scan_tries = 3 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] nvmeof_conn_info_version = 1 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] nvmet_ns_id = 10 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] nvmet_port_id = 1 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] osapi_max_limit = 1000 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] osapi_volume_ext_list = [] {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] osapi_volume_listen = 0.0.0.0 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] osapi_volume_listen_port = 8776 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] osapi_volume_use_ssl = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] osapi_volume_workers = 2 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] per_volume_size_limit = -1 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] periodic_fuzzy_delay = 60 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] periodic_interval = 60 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] project_id_regex = [0-9a-f\-]+ {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] public_endpoint = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] publish_errors = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] quota_backup_gigabytes = 1000 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] quota_backups = 10 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] quota_gigabytes = 1000 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] quota_groups = 10 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] quota_snapshots = 10 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] quota_volumes = 10 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] rate_limit_burst = 0 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] rate_limit_except_level = CRITICAL {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] rate_limit_interval = 0 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] reinit_driver_count = 3 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] replication_device = **** {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] report_discard_supported = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] report_interval = 120 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] reservation_clean_interval = 86400 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] reservation_expire = 86400 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] reserved_image_namespaces = [] {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-ffca968c-3eb2-4d10-a805-dca316f8ef14 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 28 19:12:24 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-ffca968c-3eb2-4d10-a805-dca316f8ef14 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83863) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] reserved_percentage = 0 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] rpc_response_timeout = 120 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] run_external_periodic_tasks = True {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] scst_target_driver = iscsi {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] scst_target_iqn_name = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] service_down_time = 720 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] shell_completion = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] snapshot_name_template = snapshot-%s {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] split_loggers = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] state_path = /opt/stack/data/cinder {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] storage_availability_zone = nova {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] storage_protocol = iSCSI {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] syslog_log_facility = LOG_USER {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] target_helper = lioadm {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] target_ip_address = 192.168.122.89 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] target_port = 3260 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] target_protocol = iscsi {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] target_secondary_ip_addresses = [] {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] trace_flags = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] transfer_api_class = cinder.transfer.api.API {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] transport_url = **** {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] until_refresh = 0 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] use_chap_auth = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] use_default_quota_class = True {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] use_journal = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] use_json = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] use_multipath_for_image_xfer = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] use_stderr = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] use_syslog = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] verify_glance_signatures = enabled {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] volume_api_class = cinder.volume.api.API {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] volume_backend_name = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] volume_clear = zero {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] volume_clear_ionice = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] volume_clear_size = 0 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] volume_copy_bps_limit = 0 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] volume_dd_blocksize = 1M {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] volume_name_template = volume-%s {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] volume_service_inithost_offload = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] volume_usage_audit_period = month {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] zoning_mode = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_concurrency.disable_process_locking = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] keystone_authtoken.admin_password = **** {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] keystone_authtoken.admin_token = **** {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] keystone_authtoken.admin_user = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] keystone_authtoken.auth_admin_prefix = {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] keystone_authtoken.auth_port = 35357 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] keystone_authtoken.auth_protocol = https {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] keystone_authtoken.auth_section = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] keystone_authtoken.auth_type = password {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] keystone_authtoken.auth_uri = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] keystone_authtoken.auth_version = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] keystone_authtoken.cache = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] keystone_authtoken.certfile = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] keystone_authtoken.delay_auth_decision = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] keystone_authtoken.http_connect_timeout = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] keystone_authtoken.identity_uri = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] keystone_authtoken.include_service_catalog = True {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] keystone_authtoken.insecure = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] keystone_authtoken.interface = public {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] keystone_authtoken.keyfile = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] keystone_authtoken.memcache_password = {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] keystone_authtoken.memcache_username = {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] keystone_authtoken.region_name = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] keystone_authtoken.service_token_roles_required = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] keystone_authtoken.service_type = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] keystone_authtoken.token_cache_time = 300 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.89/identity {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] cache.backend = dogpile.cache.null {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] cache.backend_argument = **** {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] cache.backend_expiration_time = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] cache.config_prefix = cache.oslo {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] cache.debug_cache_backend = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] cache.enable_retry_client = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] cache.enable_socket_keepalive = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] cache.enabled = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] cache.enforce_fips_mode = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] cache.expiration_time = 600 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] cache.hashclient_retry_attempts = 2 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] cache.memcache_dead_retry = 300 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] cache.memcache_pool_maxsize = 10 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] cache.memcache_sasl_enabled = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] cache.password = **** {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] cache.proxies = [] {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] cache.redis_db = 0 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] cache.redis_sentinel_service_name = mymaster {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] cache.redis_server = localhost:6379 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] cache.retry_attempts = 2 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] cache.retry_delay = 0.0 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] cache.socket_keepalive_count = 1 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] cache.socket_keepalive_idle = 1 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] cache.socket_keepalive_interval = 1 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] cache.socket_timeout = 1.0 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] cache.tls_allowed_ciphers = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] cache.tls_cafile = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] cache.tls_certfile = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] cache.tls_enabled = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] cache.tls_keyfile = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] cache.username = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] coordination.backend_url = **** {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] database.asyncio_connection = **** {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] database.asyncio_slave_connection = **** {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] database.backend = sqlalchemy {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] database.connection = **** {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] database.connection_debug = 0 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] database.connection_parameters = {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] database.connection_recycle_time = 3600 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] database.connection_trace = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] database.db_inc_retry_interval = True {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] database.db_max_retries = 20 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] database.db_max_retry_interval = 10 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] database.db_retry_interval = 1 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] database.max_overflow = 50 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] database.max_pool_size = 5 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] database.max_retries = 10 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] database.mysql_wsrep_sync_wait = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] database.pool_timeout = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] database.retry_interval = 10 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] database.slave_connection = **** {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] database.sqlite_synchronous = True {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] database.synchronous_reader = True {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] database.use_db_reconnect = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] profiler.connection_string = messaging:// {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] profiler.enabled = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] profiler.es_doc_type = notification {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] profiler.es_scroll_size = 10000 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] profiler.es_scroll_time = 2m {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] profiler.filter_error_trace = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] profiler.hmac_keys = **** {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] profiler.sentinel_service_name = mymaster {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] profiler.socket_timeout = 0.1 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] profiler.trace_requests = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] profiler.trace_sqlalchemy = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] profiler_jaeger.process_tags = {} {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] profiler_jaeger.service_name_prefix = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] profiler_otlp.service_name_prefix = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_policy.enforce_new_defaults = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: WARNING oslo_config.cfg [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_policy.enforce_scope = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_policy.policy_default_rule = default {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_policy.policy_file = policy.yaml {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_policy.remote_timeout = 60.0 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] privsep_osbrick.group = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] privsep_osbrick.helper_command = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ffca968c-3eb2-4d10-a805-dca316f8ef14 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83863) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 28 19:12:24 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.quobyte [None req-ffca968c-3eb2-4d10-a805-dca316f8ef14 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 28 19:12:24 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.quobyte [None req-ffca968c-3eb2-4d10-a805-dca316f8ef14 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ffca968c-3eb2-4d10-a805-dca316f8ef14 None None] Running cmd (subprocess): mount.quobyte {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] privsep_osbrick.user = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] cinder_sys_admin.group = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] cinder_sys_admin.helper_command = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] cinder_sys_admin.user = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] service_user.auth_section = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] service_user.auth_type = password {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] service_user.cafile = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] service_user.certfile = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] service_user.collect_timing = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] service_user.insecure = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] service_user.keyfile = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] service_user.send_service_user_token = True {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] service_user.split_loggers = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] service_user.timeout = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] glance.auth_section = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] glance.auth_type = password {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] glance.certfile = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] glance.collect_timing = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] glance.insecure = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] glance.keyfile = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] glance.region_name = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] glance.split_loggers = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] glance.timeout = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.backend_availability_zone = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.chap_password = **** {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.chap_username = {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.disk_geometry = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.driver_client_cert = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.driver_client_cert_key = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.driver_data_namespace = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.driver_use_ssl = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.enable_unsupported_driver = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.extra_capabilities = {} {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.filter_function = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.goodness_function = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.iscsi_target_flags = {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.iscsi_write_cache = on {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.iser_helper = tgtadm {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.iser_ip_address = 192.168.122.89 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.iser_port = 3260 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.nas_host = {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.nas_login = admin {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.nas_mount_options = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.nas_password = **** {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.nas_private_key = {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.nas_share_path = {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.nas_ssh_port = 22 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:24 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.num_shell_tries = 3 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.nvmet_port_id = 1 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.quobyte_client_cfg = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.quobyte_volume_url = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.replication_device = **** {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.report_discard_supported = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.reserved_percentage = 0 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.scst_target_driver = iscsi {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.scst_target_iqn_name = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.storage_protocol = iSCSI {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.target_helper = tgtadm {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.target_ip_address = 192.168.122.89 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.target_port = 3260 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.target_protocol = iscsi {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.trace_flags = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.unique_fqdn_network = True {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.use_chap_auth = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.volume_backend_name = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.volume_clear = zero {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.volume_clear_ionice = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.volume_clear_size = 0 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_reports.file_event_handler = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_reports.log_dir = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.backend_availability_zone = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.backend_host = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.chap_password = **** {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.chap_username = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.chiscsi_conf = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.disk_geometry = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.driver_client_cert = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.driver_client_cert_key = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.driver_data_namespace = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.driver_use_ssl = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.extra_capabilities = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.filter_function = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.goodness_function = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.iscsi_target_flags = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.iscsi_write_cache = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.iser_helper = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.iser_ip_address = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.iser_port = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack quobyte-client[83868]: Reading configuration file: /etc/quobyte/client.cfg Apr 28 19:12:25 devstack quobyte-client[83868]: Invalid parameters found, error: missing mount point. Apr 28 19:12:25 devstack quobyte-client[83868]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.iser_target_prefix = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack quobyte-client[83868]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.nas_host = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.nas_login = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.nas_mount_options = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.nas_password = **** {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.nas_private_key = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.nas_share_path = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.nas_ssh_port = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.num_iser_scan_tries = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.num_shell_tries = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.nvmet_ns_id = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ffca968c-3eb2-4d10-a805-dca316f8ef14 None None] CMD "mount.quobyte" returned: 1 in 0.125s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:12:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ffca968c-3eb2-4d10-a805-dca316f8ef14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:12:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ffca968c-3eb2-4d10-a805-dca316f8ef14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.nvmet_port_id = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ffca968c-3eb2-4d10-a805-dca316f8ef14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.replication_device = **** {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.report_discard_supported = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.reserved_percentage = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.scst_target_driver = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.storage_protocol = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.target_helper = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.target_ip_address = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.target_port = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.target_prefix = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.target_protocol = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.trace_flags = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.unique_fqdn_network = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.use_chap_auth = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ffca968c-3eb2-4d10-a805-dca316f8ef14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.volume_clear = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.volume_clear_ionice = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.volume_clear_size = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.volume_dd_blocksize = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ffca968c-3eb2-4d10-a805-dca316f8ef14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] QuobyteHD.volumes_dir = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ffca968c-3eb2-4d10-a805-dca316f8ef14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_messaging_rabbit.ssl = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_messaging_rabbit.ssl_version = {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_messaging_notifications.driver = [] {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_messaging_notifications.retry = -1 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] oslo_messaging_notifications.transport_url = **** {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] key_manager.fixed_key = **** {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack sudo[83869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] barbican.barbican_api_version = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] barbican.barbican_endpoint = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] barbican.barbican_endpoint_type = public {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] barbican.barbican_region_name = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack sudo[83869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] barbican.cafile = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] barbican.certfile = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] barbican.collect_timing = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] barbican.insecure = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] barbican.keyfile = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] barbican.number_of_retries = 60 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] barbican.retry_delay = 1 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] barbican.send_service_user_token = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] barbican.split_loggers = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] barbican.timeout = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] barbican.verify_ssl = True {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] barbican.verify_ssl_path = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] barbican_service_user.auth_section = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] barbican_service_user.auth_type = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] barbican_service_user.cafile = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] barbican_service_user.certfile = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] barbican_service_user.collect_timing = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] barbican_service_user.insecure = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] barbican_service_user.keyfile = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] barbican_service_user.split_loggers = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] barbican_service_user.timeout = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] vault.approle_role_id = **** {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] vault.approle_secret_id = **** {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] vault.kv_mountpoint = secret {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] vault.kv_path = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] vault.kv_version = 2 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] vault.namespace = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] vault.root_token_id = **** {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] vault.ssl_ca_crt_file = None {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] vault.timeout = 60.0 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] vault.use_ssl = False {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 19:12:25 devstack cinder-volume[83621]: DEBUG oslo_service.backend._eventlet.service [None req-12b8ba48-83df-4e0b-9ff4-b8dba781e11f None None] ******************************************************************************** {{(pid=83621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Apr 28 19:12:25 devstack sudo[83869]: pam_unix(sudo:session): session closed for user root Apr 28 19:12:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ffca968c-3eb2-4d10-a805-dca316f8ef14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.779s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:12:25 devstack cinder-volume[83863]: INFO cinder.volume.driver [None req-ffca968c-3eb2-4d10-a805-dca316f8ef14 None None] Driver hasn't implemented _init_vendor_properties() Apr 28 19:12:25 devstack cinder-volume[83863]: DEBUG cinder.volume.driver [None req-ffca968c-3eb2-4d10-a805-dca316f8ef14 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6508674621582, 'free_capacity_gb': 1775.6508674621582, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83863) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 28 19:12:25 devstack cinder-volume[83863]: DEBUG oslo_db.sqlalchemy.engines [None req-ffca968c-3eb2-4d10-a805-dca316f8ef14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83863) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 19:12:25 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writer thread running {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 28 19:12:25 devstack cinder-volume[83863]: DEBUG cinder.db.sqlalchemy.api [None req-ffca968c-3eb2-4d10-a805-dca316f8ef14 None None] Building query based on filter {{(pid=83863) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 28 19:12:25 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-ffca968c-3eb2-4d10-a805-dca316f8ef14 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83863) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 28 19:12:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ffca968c-3eb2-4d10-a805-dca316f8ef14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:12:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ffca968c-3eb2-4d10-a805-dca316f8ef14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:12:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ffca968c-3eb2-4d10-a805-dca316f8ef14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:12:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ffca968c-3eb2-4d10-a805-dca316f8ef14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:12:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ffca968c-3eb2-4d10-a805-dca316f8ef14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:12:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ffca968c-3eb2-4d10-a805-dca316f8ef14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:12:26 devstack cinder-volume[83863]: INFO cinder.keymgr.migration [None req-5adb31f2-f6b8-436e-b21f-081e8add8d0e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 28 19:12:26 devstack sudo[83880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:12:26 devstack sudo[83880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:12:26 devstack sudo[83880]: pam_unix(sudo:session): session closed for user root Apr 28 19:12:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ffca968c-3eb2-4d10-a805-dca316f8ef14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.620s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:12:26 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-ffca968c-3eb2-4d10-a805-dca316f8ef14 None None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:12:26 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-ffca968c-3eb2-4d10-a805-dca316f8ef14 None None] Driver initialization completed successfully. Apr 28 19:12:26 devstack cinder-volume[83863]: INFO cinder.manager [None req-ffca968c-3eb2-4d10-a805-dca316f8ef14 None None] Initiating service 3 cleanup Apr 28 19:12:26 devstack cinder-volume[83863]: INFO cinder.manager [None req-ffca968c-3eb2-4d10-a805-dca316f8ef14 None None] Service 3 cleanup completed. Apr 28 19:12:26 devstack cinder-volume[83863]: DEBUG cinder.service [None req-ffca968c-3eb2-4d10-a805-dca316f8ef14 None None] Creating RPC server for service cinder-volume {{(pid=83863) start /opt/stack/cinder/cinder/service.py:231}} Apr 28 19:12:26 devstack cinder-volume[83863]: DEBUG cinder.service [None req-ffca968c-3eb2-4d10-a805-dca316f8ef14 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83863) start /opt/stack/cinder/cinder/service.py:237}} Apr 28 19:12:26 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-ffca968c-3eb2-4d10-a805-dca316f8ef14 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 28 19:12:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ffca968c-3eb2-4d10-a805-dca316f8ef14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:12:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ffca968c-3eb2-4d10-a805-dca316f8ef14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:12:26 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ffca968c-3eb2-4d10-a805-dca316f8ef14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:12:26 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ffca968c-3eb2-4d10-a805-dca316f8ef14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:12:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ffca968c-3eb2-4d10-a805-dca316f8ef14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:12:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ffca968c-3eb2-4d10-a805-dca316f8ef14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:12:26 devstack sudo[83885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:12:26 devstack sudo[83885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:12:27 devstack sudo[83885]: pam_unix(sudo:session): session closed for user root Apr 28 19:12:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ffca968c-3eb2-4d10-a805-dca316f8ef14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.598s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:12:27 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-ffca968c-3eb2-4d10-a805-dca316f8ef14 None None] Driver post RPC initialization completed successfully. Apr 28 19:12:34 devstack cinder-volume[83621]: DEBUG dbcounter [-] [83621] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=83621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 19:12:36 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 19:12:37 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:SELECT=3 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 19:13:54 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cb5bf17-2e6b-4d5f-8711-0a2df81cf412 tempest-VolumesAdminNegativeTest-1681183515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:13:54 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1cb5bf17-2e6b-4d5f-8711-0a2df81cf412 tempest-VolumesAdminNegativeTest-1681183515 None] Flow 'volume_create_manager' (dcb05e2c-ddb7-4025-ba4b-da9e7ef24075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:13:54 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1cb5bf17-2e6b-4d5f-8711-0a2df81cf412 tempest-VolumesAdminNegativeTest-1681183515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3278a4c-d0b3-4a61-8559-ac67492d8a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:13:54 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1cb5bf17-2e6b-4d5f-8711-0a2df81cf412 tempest-VolumesAdminNegativeTest-1681183515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3278a4c-d0b3-4a61-8559-ac67492d8a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2103216335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac6abaf1-4f42-4a46-972f-9437ce095af9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ff3e7f74560460284e99825b05788a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:13:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:13:54Z,use_quota=True,user_id='630b3654e2f0419c874478c00e9ae9a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:13:54 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1cb5bf17-2e6b-4d5f-8711-0a2df81cf412 tempest-VolumesAdminNegativeTest-1681183515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bd3ea36-d1b8-424b-bc5a-7b23a7b6e04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:13:54 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1cb5bf17-2e6b-4d5f-8711-0a2df81cf412 tempest-VolumesAdminNegativeTest-1681183515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bd3ea36-d1b8-424b-bc5a-7b23a7b6e04d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:13:54 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1cb5bf17-2e6b-4d5f-8711-0a2df81cf412 tempest-VolumesAdminNegativeTest-1681183515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13ada0a2-7f90-4ea6-b2da-26201d37f4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:13:54 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1cb5bf17-2e6b-4d5f-8711-0a2df81cf412 tempest-VolumesAdminNegativeTest-1681183515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13ada0a2-7f90-4ea6-b2da-26201d37f4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac6abaf1-4f42-4a46-972f-9437ce095af9', 'volume_name': 'volume-ac6abaf1-4f42-4a46-972f-9437ce095af9', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:13:54 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1cb5bf17-2e6b-4d5f-8711-0a2df81cf412 tempest-VolumesAdminNegativeTest-1681183515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc3c614d-b39e-499d-966f-ea2225c7ab1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:13:54 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1cb5bf17-2e6b-4d5f-8711-0a2df81cf412 tempest-VolumesAdminNegativeTest-1681183515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc3c614d-b39e-499d-966f-ea2225c7ab1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:13:54 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1cb5bf17-2e6b-4d5f-8711-0a2df81cf412 tempest-VolumesAdminNegativeTest-1681183515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73b815a0-6547-4db6-9a6d-5ce7cce48a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:13:54 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-1cb5bf17-2e6b-4d5f-8711-0a2df81cf412 tempest-VolumesAdminNegativeTest-1681183515 None] Volume ac6abaf1-4f42-4a46-972f-9437ce095af9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac6abaf1-4f42-4a46-972f-9437ce095af9', 'volume_size': 1} Apr 28 19:13:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1cb5bf17-2e6b-4d5f-8711-0a2df81cf412 tempest-VolumesAdminNegativeTest-1681183515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:13:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1cb5bf17-2e6b-4d5f-8711-0a2df81cf412 tempest-VolumesAdminNegativeTest-1681183515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:13:54 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1cb5bf17-2e6b-4d5f-8711-0a2df81cf412 tempest-VolumesAdminNegativeTest-1681183515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2103216335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac6abaf1-4f42-4a46-972f-9437ce095af9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ff3e7f74560460284e99825b05788a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:13:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:13:54Z,use_quota=True,user_id='630b3654e2f0419c874478c00e9ae9a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:13:54 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-1cb5bf17-2e6b-4d5f-8711-0a2df81cf412 tempest-VolumesAdminNegativeTest-1681183515 None] Creating volume ac6abaf1-4f42-4a46-972f-9437ce095af9 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:13:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1cb5bf17-2e6b-4d5f-8711-0a2df81cf412 tempest-VolumesAdminNegativeTest-1681183515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:13:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1cb5bf17-2e6b-4d5f-8711-0a2df81cf412 tempest-VolumesAdminNegativeTest-1681183515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:13:54 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1cb5bf17-2e6b-4d5f-8711-0a2df81cf412 tempest-VolumesAdminNegativeTest-1681183515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:13:54 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1cb5bf17-2e6b-4d5f-8711-0a2df81cf412 tempest-VolumesAdminNegativeTest-1681183515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:13:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1cb5bf17-2e6b-4d5f-8711-0a2df81cf412 tempest-VolumesAdminNegativeTest-1681183515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:13:54 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1cb5bf17-2e6b-4d5f-8711-0a2df81cf412 tempest-VolumesAdminNegativeTest-1681183515 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:13:54 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-1cb5bf17-2e6b-4d5f-8711-0a2df81cf412 tempest-VolumesAdminNegativeTest-1681183515 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:13:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1cb5bf17-2e6b-4d5f-8711-0a2df81cf412 tempest-VolumesAdminNegativeTest-1681183515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ac6abaf1-4f42-4a46-972f-9437ce095af9 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:13:54 devstack sudo[84669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ac6abaf1-4f42-4a46-972f-9437ce095af9 1073741824 Apr 28 19:13:54 devstack sudo[84669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:13:56 devstack sudo[84669]: pam_unix(sudo:session): session closed for user root Apr 28 19:13:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1cb5bf17-2e6b-4d5f-8711-0a2df81cf412 tempest-VolumesAdminNegativeTest-1681183515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ac6abaf1-4f42-4a46-972f-9437ce095af9 1073741824" returned: 0 in 2.159s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:13:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1cb5bf17-2e6b-4d5f-8711-0a2df81cf412 tempest-VolumesAdminNegativeTest-1681183515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ac6abaf1-4f42-4a46-972f-9437ce095af9 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:13:56 devstack sudo[85030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ac6abaf1-4f42-4a46-972f-9437ce095af9 Apr 28 19:13:56 devstack sudo[85030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:13:58 devstack sudo[85030]: pam_unix(sudo:session): session closed for user root Apr 28 19:13:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1cb5bf17-2e6b-4d5f-8711-0a2df81cf412 tempest-VolumesAdminNegativeTest-1681183515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ac6abaf1-4f42-4a46-972f-9437ce095af9" returned: 0 in 1.859s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:13:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1cb5bf17-2e6b-4d5f-8711-0a2df81cf412 tempest-VolumesAdminNegativeTest-1681183515 None] <== create_volume: return (4164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:13:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1cb5bf17-2e6b-4d5f-8711-0a2df81cf412 tempest-VolumesAdminNegativeTest-1681183515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.176s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:13:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1cb5bf17-2e6b-4d5f-8711-0a2df81cf412 tempest-VolumesAdminNegativeTest-1681183515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73b815a0-6547-4db6-9a6d-5ce7cce48a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac6abaf1-4f42-4a46-972f-9437ce095af9', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:13:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1cb5bf17-2e6b-4d5f-8711-0a2df81cf412 tempest-VolumesAdminNegativeTest-1681183515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97bd9441-ffe7-4ef5-a584-06b9992e1233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:13:58 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-1cb5bf17-2e6b-4d5f-8711-0a2df81cf412 tempest-VolumesAdminNegativeTest-1681183515 None] Volume volume-ac6abaf1-4f42-4a46-972f-9437ce095af9 (ac6abaf1-4f42-4a46-972f-9437ce095af9): created successfully Apr 28 19:13:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1cb5bf17-2e6b-4d5f-8711-0a2df81cf412 tempest-VolumesAdminNegativeTest-1681183515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97bd9441-ffe7-4ef5-a584-06b9992e1233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:13:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1cb5bf17-2e6b-4d5f-8711-0a2df81cf412 tempest-VolumesAdminNegativeTest-1681183515 None] Flow 'volume_create_manager' (dcb05e2c-ddb7-4025-ba4b-da9e7ef24075) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:13:58 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-1cb5bf17-2e6b-4d5f-8711-0a2df81cf412 tempest-VolumesAdminNegativeTest-1681183515 None] Created volume successfully. Apr 28 19:14:02 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-1baa90d2-1083-4f02-80ae-b335f8e3016d tempest-VolumesAdminNegativeTest-1681183515 None] Acquiring lock "cinder-ac6abaf1-4f42-4a46-972f-9437ce095af9-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:14:02 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-1baa90d2-1083-4f02-80ae-b335f8e3016d tempest-VolumesAdminNegativeTest-1681183515 None] Lock "cinder-ac6abaf1-4f42-4a46-972f-9437ce095af9-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:14:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-1baa90d2-1083-4f02-80ae-b335f8e3016d tempest-VolumesAdminNegativeTest-1681183515 None] Acquiring lock "cinder-quobyte-ac6abaf1-4f42-4a46-972f-9437ce095af9" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:14:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-1baa90d2-1083-4f02-80ae-b335f8e3016d tempest-VolumesAdminNegativeTest-1681183515 None] Lock "cinder-quobyte-ac6abaf1-4f42-4a46-972f-9437ce095af9" acquired by "delete_volume" :: waited 0.059s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:14:03 devstack cinder-volume[83863]: INFO oslo.privsep.daemon [None req-1baa90d2-1083-4f02-80ae-b335f8e3016d tempest-VolumesAdminNegativeTest-1681183515 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpo771lzja/privsep.sock'] Apr 28 19:14:03 devstack sudo[85096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpo771lzja/privsep.sock Apr 28 19:14:03 devstack sudo[85096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:14:03 devstack cinder-volume[83863]: DEBUG oslo_service.periodic_task [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 28 19:14:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:14:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:14:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:14:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:14:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:14:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:14:03 devstack sudo[85098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:14:03 devstack sudo[85098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:14:05 devstack sudo[85098]: pam_unix(sudo:session): session closed for user root Apr 28 19:14:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 1.991s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:14:05 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:14:07 devstack sudo[85096]: pam_unix(sudo:session): session closed for user root Apr 28 19:14:07 devstack cinder-volume[83863]: INFO oslo.privsep.daemon [None req-1baa90d2-1083-4f02-80ae-b335f8e3016d tempest-VolumesAdminNegativeTest-1681183515 None] Spawned new privsep daemon via rootwrap Apr 28 19:14:07 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [None req-1baa90d2-1083-4f02-80ae-b335f8e3016d tempest-VolumesAdminNegativeTest-1681183515 None] Accepted privsep connection to /tmp/tmpo771lzja/privsep.sock {{(pid=83863) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:418}} Apr 28 19:14:07 devstack cinder-volume[83863]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 28 19:14:07 devstack cinder-volume[83863]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 28 19:14:07 devstack cinder-volume[83863]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 28 19:14:07 devstack cinder-volume[83863]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85107 Apr 28 19:14:07 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d381a317-8c45-4930-963f-09b98678a5b9]: (2,) {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:14:07 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c4a251-1647-4e89-a874-d179b8efe589]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:14:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1baa90d2-1083-4f02-80ae-b335f8e3016d tempest-VolumesAdminNegativeTest-1681183515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ac6abaf1-4f42-4a46-972f-9437ce095af9 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:14:07 devstack sudo[85109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ac6abaf1-4f42-4a46-972f-9437ce095af9 Apr 28 19:14:07 devstack sudo[85109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:14:09 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-c19d8508-ed88-4678-999f-34f227f2cf68 tempest-ServerRescueNegativeTestJSON-1063303551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:14:09 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c19d8508-ed88-4678-999f-34f227f2cf68 tempest-ServerRescueNegativeTestJSON-1063303551 None] Flow 'volume_create_manager' (47694689-f36c-4460-a644-0459e36843de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:14:09 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c19d8508-ed88-4678-999f-34f227f2cf68 tempest-ServerRescueNegativeTestJSON-1063303551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d7ad6f9-05ac-4e24-a998-d96b87ce526d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:14:09 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c19d8508-ed88-4678-999f-34f227f2cf68 tempest-ServerRescueNegativeTestJSON-1063303551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d7ad6f9-05ac-4e24-a998-d96b87ce526d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-495915456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=760f89ea-83c1-46e1-bd4e-4ed5a542c319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='001e4f6839464127a5ec9d88657c7d32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:14:09Z,use_quota=True,user_id='5d78b86721b74715bb45005e30bcd694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:14:09 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c19d8508-ed88-4678-999f-34f227f2cf68 tempest-ServerRescueNegativeTestJSON-1063303551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26545dad-baa9-49e1-8a15-565466ffd8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:14:09 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c19d8508-ed88-4678-999f-34f227f2cf68 tempest-ServerRescueNegativeTestJSON-1063303551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26545dad-baa9-49e1-8a15-565466ffd8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:14:09 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c19d8508-ed88-4678-999f-34f227f2cf68 tempest-ServerRescueNegativeTestJSON-1063303551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1197fd8-b664-4753-9f4d-e9a519bd241e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:14:09 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c19d8508-ed88-4678-999f-34f227f2cf68 tempest-ServerRescueNegativeTestJSON-1063303551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1197fd8-b664-4753-9f4d-e9a519bd241e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '760f89ea-83c1-46e1-bd4e-4ed5a542c319', 'volume_name': 'volume-760f89ea-83c1-46e1-bd4e-4ed5a542c319', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:14:09 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c19d8508-ed88-4678-999f-34f227f2cf68 tempest-ServerRescueNegativeTestJSON-1063303551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a026cf4c-6bb0-4b35-9023-3cf683de9278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:14:09 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c19d8508-ed88-4678-999f-34f227f2cf68 tempest-ServerRescueNegativeTestJSON-1063303551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a026cf4c-6bb0-4b35-9023-3cf683de9278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:14:09 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c19d8508-ed88-4678-999f-34f227f2cf68 tempest-ServerRescueNegativeTestJSON-1063303551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71c7ad29-0c24-4cad-a656-9b732dbcf31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:14:09 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-c19d8508-ed88-4678-999f-34f227f2cf68 tempest-ServerRescueNegativeTestJSON-1063303551 None] Volume 760f89ea-83c1-46e1-bd4e-4ed5a542c319: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-760f89ea-83c1-46e1-bd4e-4ed5a542c319', 'volume_size': 1} Apr 28 19:14:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c19d8508-ed88-4678-999f-34f227f2cf68 tempest-ServerRescueNegativeTestJSON-1063303551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:14:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c19d8508-ed88-4678-999f-34f227f2cf68 tempest-ServerRescueNegativeTestJSON-1063303551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:14:09 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c19d8508-ed88-4678-999f-34f227f2cf68 tempest-ServerRescueNegativeTestJSON-1063303551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-495915456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=760f89ea-83c1-46e1-bd4e-4ed5a542c319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='001e4f6839464127a5ec9d88657c7d32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:14:09Z,use_quota=True,user_id='5d78b86721b74715bb45005e30bcd694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:14:09 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-c19d8508-ed88-4678-999f-34f227f2cf68 tempest-ServerRescueNegativeTestJSON-1063303551 None] Creating volume 760f89ea-83c1-46e1-bd4e-4ed5a542c319 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:14:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c19d8508-ed88-4678-999f-34f227f2cf68 tempest-ServerRescueNegativeTestJSON-1063303551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:14:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c19d8508-ed88-4678-999f-34f227f2cf68 tempest-ServerRescueNegativeTestJSON-1063303551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:14:09 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c19d8508-ed88-4678-999f-34f227f2cf68 tempest-ServerRescueNegativeTestJSON-1063303551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:14:09 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c19d8508-ed88-4678-999f-34f227f2cf68 tempest-ServerRescueNegativeTestJSON-1063303551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:14:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c19d8508-ed88-4678-999f-34f227f2cf68 tempest-ServerRescueNegativeTestJSON-1063303551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:14:09 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c19d8508-ed88-4678-999f-34f227f2cf68 tempest-ServerRescueNegativeTestJSON-1063303551 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:14:09 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-c19d8508-ed88-4678-999f-34f227f2cf68 tempest-ServerRescueNegativeTestJSON-1063303551 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:14:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c19d8508-ed88-4678-999f-34f227f2cf68 tempest-ServerRescueNegativeTestJSON-1063303551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-760f89ea-83c1-46e1-bd4e-4ed5a542c319 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:14:09 devstack sudo[85114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-760f89ea-83c1-46e1-bd4e-4ed5a542c319 1073741824 Apr 28 19:14:09 devstack sudo[85114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:14:09 devstack sudo[85109]: pam_unix(sudo:session): session closed for user root Apr 28 19:14:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1baa90d2-1083-4f02-80ae-b335f8e3016d tempest-VolumesAdminNegativeTest-1681183515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ac6abaf1-4f42-4a46-972f-9437ce095af9" returned: 0 in 2.207s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:14:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1baa90d2-1083-4f02-80ae-b335f8e3016d tempest-VolumesAdminNegativeTest-1681183515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ac6abaf1-4f42-4a46-972f-9437ce095af9 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:14:09 devstack sudo[85119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ac6abaf1-4f42-4a46-972f-9437ce095af9 Apr 28 19:14:09 devstack sudo[85119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:14:11 devstack sudo[85114]: pam_unix(sudo:session): session closed for user root Apr 28 19:14:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c19d8508-ed88-4678-999f-34f227f2cf68 tempest-ServerRescueNegativeTestJSON-1063303551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-760f89ea-83c1-46e1-bd4e-4ed5a542c319 1073741824" returned: 0 in 1.825s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:14:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c19d8508-ed88-4678-999f-34f227f2cf68 tempest-ServerRescueNegativeTestJSON-1063303551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-760f89ea-83c1-46e1-bd4e-4ed5a542c319 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:14:11 devstack sudo[85152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-760f89ea-83c1-46e1-bd4e-4ed5a542c319 Apr 28 19:14:11 devstack sudo[85152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:14:11 devstack sudo[85119]: pam_unix(sudo:session): session closed for user root Apr 28 19:14:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1baa90d2-1083-4f02-80ae-b335f8e3016d tempest-VolumesAdminNegativeTest-1681183515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ac6abaf1-4f42-4a46-972f-9437ce095af9" returned: 0 in 1.601s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:14:11 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-1baa90d2-1083-4f02-80ae-b335f8e3016d tempest-VolumesAdminNegativeTest-1681183515 None] Lock "cinder-quobyte-ac6abaf1-4f42-4a46-972f-9437ce095af9" released by "delete_volume" :: held 8.128s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:14:11 devstack cinder-volume[83863]: WARNING cinder.quota [None req-1baa90d2-1083-4f02-80ae-b335f8e3016d tempest-VolumesAdminNegativeTest-1681183515 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 28 19:14:11 devstack cinder-volume[83863]: WARNING cinder.quota [None req-1baa90d2-1083-4f02-80ae-b335f8e3016d tempest-VolumesAdminNegativeTest-1681183515 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 28 19:14:11 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-1baa90d2-1083-4f02-80ae-b335f8e3016d tempest-VolumesAdminNegativeTest-1681183515 None] Created reservations ['33764b71-245e-4048-bec1-b9ae30f36126', 'e3cb76a5-d7ba-4453-890b-23f628594d9c', '1edff9c0-e502-48f4-86d0-36527a6c0626', '690fd48d-30b3-4cef-bdee-a194f5b133cb'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:14:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1baa90d2-1083-4f02-80ae-b335f8e3016d tempest-VolumesAdminNegativeTest-1681183515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:14:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1baa90d2-1083-4f02-80ae-b335f8e3016d tempest-VolumesAdminNegativeTest-1681183515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:14:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1baa90d2-1083-4f02-80ae-b335f8e3016d tempest-VolumesAdminNegativeTest-1681183515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:14:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1baa90d2-1083-4f02-80ae-b335f8e3016d tempest-VolumesAdminNegativeTest-1681183515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:14:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1baa90d2-1083-4f02-80ae-b335f8e3016d tempest-VolumesAdminNegativeTest-1681183515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.057s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:14:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1baa90d2-1083-4f02-80ae-b335f8e3016d tempest-VolumesAdminNegativeTest-1681183515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:14:11 devstack sudo[85173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:14:11 devstack sudo[85173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:14:12 devstack sudo[85152]: pam_unix(sudo:session): session closed for user root Apr 28 19:14:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c19d8508-ed88-4678-999f-34f227f2cf68 tempest-ServerRescueNegativeTestJSON-1063303551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-760f89ea-83c1-46e1-bd4e-4ed5a542c319" returned: 0 in 1.380s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:14:12 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c19d8508-ed88-4678-999f-34f227f2cf68 tempest-ServerRescueNegativeTestJSON-1063303551 None] <== create_volume: return (3276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:14:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c19d8508-ed88-4678-999f-34f227f2cf68 tempest-ServerRescueNegativeTestJSON-1063303551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.286s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:14:12 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c19d8508-ed88-4678-999f-34f227f2cf68 tempest-ServerRescueNegativeTestJSON-1063303551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71c7ad29-0c24-4cad-a656-9b732dbcf31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-760f89ea-83c1-46e1-bd4e-4ed5a542c319', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:14:12 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c19d8508-ed88-4678-999f-34f227f2cf68 tempest-ServerRescueNegativeTestJSON-1063303551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52c3f350-2950-4789-8519-54140cc87d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:14:12 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-c19d8508-ed88-4678-999f-34f227f2cf68 tempest-ServerRescueNegativeTestJSON-1063303551 None] Volume volume-760f89ea-83c1-46e1-bd4e-4ed5a542c319 (760f89ea-83c1-46e1-bd4e-4ed5a542c319): created successfully Apr 28 19:14:12 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c19d8508-ed88-4678-999f-34f227f2cf68 tempest-ServerRescueNegativeTestJSON-1063303551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52c3f350-2950-4789-8519-54140cc87d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:14:12 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c19d8508-ed88-4678-999f-34f227f2cf68 tempest-ServerRescueNegativeTestJSON-1063303551 None] Flow 'volume_create_manager' (47694689-f36c-4460-a644-0459e36843de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:14:12 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-c19d8508-ed88-4678-999f-34f227f2cf68 tempest-ServerRescueNegativeTestJSON-1063303551 None] Created volume successfully. Apr 28 19:14:13 devstack sudo[85173]: pam_unix(sudo:session): session closed for user root Apr 28 19:14:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1baa90d2-1083-4f02-80ae-b335f8e3016d tempest-VolumesAdminNegativeTest-1681183515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 1.672s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:14:13 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-1baa90d2-1083-4f02-80ae-b335f8e3016d tempest-VolumesAdminNegativeTest-1681183515 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:14:13 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-1baa90d2-1083-4f02-80ae-b335f8e3016d tempest-VolumesAdminNegativeTest-1681183515 None] Deleted volume successfully. Apr 28 19:14:13 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-1baa90d2-1083-4f02-80ae-b335f8e3016d tempest-VolumesAdminNegativeTest-1681183515 None] Lock "cinder-ac6abaf1-4f42-4a46-972f-9437ce095af9-delete_volume" released by "delete_volume" :: held 10.625s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:14:14 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-818f73aa-897b-4deb-9fde-48f4aee6005d tempest-GroupsV320Test-1463590916 None] Group tempest-GroupsV320Test-Group-1222853315: creating Apr 28 19:14:14 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-818f73aa-897b-4deb-9fde-48f4aee6005d tempest-GroupsV320Test-1463590916 None] Group tempest-GroupsV320Test-Group-1222853315: created successfully Apr 28 19:14:14 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-818f73aa-897b-4deb-9fde-48f4aee6005d tempest-GroupsV320Test-1463590916 None] Create group completed successfully. Apr 28 19:14:16 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-5bf29fcc-76f9-4e03-93e6-e70f70d3c5cc tempest-GroupsV320Test-1463590916 None] Created reservations ['8b2c5a2d-6314-402e-a9c4-62470464d113'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:14:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5bf29fcc-76f9-4e03-93e6-e70f70d3c5cc tempest-GroupsV320Test-1463590916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:14:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5bf29fcc-76f9-4e03-93e6-e70f70d3c5cc tempest-GroupsV320Test-1463590916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:14:16 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5bf29fcc-76f9-4e03-93e6-e70f70d3c5cc tempest-GroupsV320Test-1463590916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:14:16 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5bf29fcc-76f9-4e03-93e6-e70f70d3c5cc tempest-GroupsV320Test-1463590916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:14:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5bf29fcc-76f9-4e03-93e6-e70f70d3c5cc tempest-GroupsV320Test-1463590916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:14:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5bf29fcc-76f9-4e03-93e6-e70f70d3c5cc tempest-GroupsV320Test-1463590916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:14:16 devstack sudo[85242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:14:16 devstack sudo[85242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:14:17 devstack sudo[85242]: pam_unix(sudo:session): session closed for user root Apr 28 19:14:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5bf29fcc-76f9-4e03-93e6-e70f70d3c5cc tempest-GroupsV320Test-1463590916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.942s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:14:17 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-5bf29fcc-76f9-4e03-93e6-e70f70d3c5cc tempest-GroupsV320Test-1463590916 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:14:17 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-5bf29fcc-76f9-4e03-93e6-e70f70d3c5cc tempest-GroupsV320Test-1463590916 None] Delete group completed successfully. Apr 28 19:14:26 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:UPDATE=20,cinder:SELECT=9,cinder:INSERT=3,cinder:DELETE=2 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 19:14:26 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:SELECT=22,cinder:UPDATE=15,cinder:INSERT=4,cinder:DELETE=1 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 19:14:28 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ace1f83-305c-464b-86b7-6b982021b358 tempest-ServersNegativeTestJSON-1348202369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:14:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6ace1f83-305c-464b-86b7-6b982021b358 tempest-ServersNegativeTestJSON-1348202369 None] Flow 'volume_create_manager' (fee48a40-07b8-4a59-9de0-55bc7c536f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:14:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6ace1f83-305c-464b-86b7-6b982021b358 tempest-ServersNegativeTestJSON-1348202369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef381ce2-8a6c-4ed8-88f2-b7c8a23a74e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:14:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6ace1f83-305c-464b-86b7-6b982021b358 tempest-ServersNegativeTestJSON-1348202369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef381ce2-8a6c-4ed8-88f2-b7c8a23a74e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:14:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-648607239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d9f79d6-095a-4e7b-a428-61a1eda50155,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f201354df064bb6ad6c050d1dd460f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:14:29Z,use_quota=True,user_id='f07dd8b661dd4e5b899fd4b55c1d473c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:14:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6ace1f83-305c-464b-86b7-6b982021b358 tempest-ServersNegativeTestJSON-1348202369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ad95e03-50c7-430e-a134-f34441c66da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:14:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6ace1f83-305c-464b-86b7-6b982021b358 tempest-ServersNegativeTestJSON-1348202369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ad95e03-50c7-430e-a134-f34441c66da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:14:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6ace1f83-305c-464b-86b7-6b982021b358 tempest-ServersNegativeTestJSON-1348202369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4a5186d-f4a6-435e-b568-85f39c140516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:14:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6ace1f83-305c-464b-86b7-6b982021b358 tempest-ServersNegativeTestJSON-1348202369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4a5186d-f4a6-435e-b568-85f39c140516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d9f79d6-095a-4e7b-a428-61a1eda50155', 'volume_name': 'volume-7d9f79d6-095a-4e7b-a428-61a1eda50155', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:14:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6ace1f83-305c-464b-86b7-6b982021b358 tempest-ServersNegativeTestJSON-1348202369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a12e4670-e96f-4ce5-87ca-41687954f15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:14:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6ace1f83-305c-464b-86b7-6b982021b358 tempest-ServersNegativeTestJSON-1348202369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a12e4670-e96f-4ce5-87ca-41687954f15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:14:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6ace1f83-305c-464b-86b7-6b982021b358 tempest-ServersNegativeTestJSON-1348202369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8aee33d-fc0b-400c-ae94-8ef813b3f90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:14:28 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-6ace1f83-305c-464b-86b7-6b982021b358 tempest-ServersNegativeTestJSON-1348202369 None] Volume 7d9f79d6-095a-4e7b-a428-61a1eda50155: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d9f79d6-095a-4e7b-a428-61a1eda50155', 'volume_size': 1} Apr 28 19:14:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6ace1f83-305c-464b-86b7-6b982021b358 tempest-ServersNegativeTestJSON-1348202369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:14:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6ace1f83-305c-464b-86b7-6b982021b358 tempest-ServersNegativeTestJSON-1348202369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:14:28 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6ace1f83-305c-464b-86b7-6b982021b358 tempest-ServersNegativeTestJSON-1348202369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:14:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-648607239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d9f79d6-095a-4e7b-a428-61a1eda50155,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f201354df064bb6ad6c050d1dd460f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:14:29Z,use_quota=True,user_id='f07dd8b661dd4e5b899fd4b55c1d473c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:14:28 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-6ace1f83-305c-464b-86b7-6b982021b358 tempest-ServersNegativeTestJSON-1348202369 None] Creating volume 7d9f79d6-095a-4e7b-a428-61a1eda50155 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:14:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6ace1f83-305c-464b-86b7-6b982021b358 tempest-ServersNegativeTestJSON-1348202369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:14:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6ace1f83-305c-464b-86b7-6b982021b358 tempest-ServersNegativeTestJSON-1348202369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:14:28 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6ace1f83-305c-464b-86b7-6b982021b358 tempest-ServersNegativeTestJSON-1348202369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:14:28 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6ace1f83-305c-464b-86b7-6b982021b358 tempest-ServersNegativeTestJSON-1348202369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:14:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6ace1f83-305c-464b-86b7-6b982021b358 tempest-ServersNegativeTestJSON-1348202369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:14:28 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6ace1f83-305c-464b-86b7-6b982021b358 tempest-ServersNegativeTestJSON-1348202369 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:14:28 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-6ace1f83-305c-464b-86b7-6b982021b358 tempest-ServersNegativeTestJSON-1348202369 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:14:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6ace1f83-305c-464b-86b7-6b982021b358 tempest-ServersNegativeTestJSON-1348202369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7d9f79d6-095a-4e7b-a428-61a1eda50155 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:14:29 devstack sudo[85442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7d9f79d6-095a-4e7b-a428-61a1eda50155 1073741824 Apr 28 19:14:29 devstack sudo[85442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:14:30 devstack sudo[85442]: pam_unix(sudo:session): session closed for user root Apr 28 19:14:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6ace1f83-305c-464b-86b7-6b982021b358 tempest-ServersNegativeTestJSON-1348202369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7d9f79d6-095a-4e7b-a428-61a1eda50155 1073741824" returned: 0 in 1.432s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:14:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6ace1f83-305c-464b-86b7-6b982021b358 tempest-ServersNegativeTestJSON-1348202369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7d9f79d6-095a-4e7b-a428-61a1eda50155 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:14:30 devstack sudo[85469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7d9f79d6-095a-4e7b-a428-61a1eda50155 Apr 28 19:14:30 devstack sudo[85469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:14:31 devstack sudo[85469]: pam_unix(sudo:session): session closed for user root Apr 28 19:14:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6ace1f83-305c-464b-86b7-6b982021b358 tempest-ServersNegativeTestJSON-1348202369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7d9f79d6-095a-4e7b-a428-61a1eda50155" returned: 0 in 1.116s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:14:31 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6ace1f83-305c-464b-86b7-6b982021b358 tempest-ServersNegativeTestJSON-1348202369 None] <== create_volume: return (2651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:14:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6ace1f83-305c-464b-86b7-6b982021b358 tempest-ServersNegativeTestJSON-1348202369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.653s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:14:31 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6ace1f83-305c-464b-86b7-6b982021b358 tempest-ServersNegativeTestJSON-1348202369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8aee33d-fc0b-400c-ae94-8ef813b3f90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d9f79d6-095a-4e7b-a428-61a1eda50155', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:14:31 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6ace1f83-305c-464b-86b7-6b982021b358 tempest-ServersNegativeTestJSON-1348202369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a30bbff-3fe3-4231-a6d7-72324d433737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:14:31 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-6ace1f83-305c-464b-86b7-6b982021b358 tempest-ServersNegativeTestJSON-1348202369 None] Volume volume-7d9f79d6-095a-4e7b-a428-61a1eda50155 (7d9f79d6-095a-4e7b-a428-61a1eda50155): created successfully Apr 28 19:14:31 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6ace1f83-305c-464b-86b7-6b982021b358 tempest-ServersNegativeTestJSON-1348202369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a30bbff-3fe3-4231-a6d7-72324d433737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:14:31 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6ace1f83-305c-464b-86b7-6b982021b358 tempest-ServersNegativeTestJSON-1348202369 None] Flow 'volume_create_manager' (fee48a40-07b8-4a59-9de0-55bc7c536f21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:14:31 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-6ace1f83-305c-464b-86b7-6b982021b358 tempest-ServersNegativeTestJSON-1348202369 None] Created volume successfully. Apr 28 19:14:36 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4cdca0a-ef74-40a4-ad52-085fe93724e5 tempest-ServersNegativeTestJSON-1348202369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:14:36 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f4cdca0a-ef74-40a4-ad52-085fe93724e5 tempest-ServersNegativeTestJSON-1348202369 None] Flow 'volume_create_manager' (0d3565ba-0f7a-4c8d-9325-9a08ca65d72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:14:36 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f4cdca0a-ef74-40a4-ad52-085fe93724e5 tempest-ServersNegativeTestJSON-1348202369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0da9a28-323a-4d90-af56-d3f20be7c73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:14:36 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f4cdca0a-ef74-40a4-ad52-085fe93724e5 tempest-ServersNegativeTestJSON-1348202369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0da9a28-323a-4d90-af56-d3f20be7c73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-338282575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec082cfc-902a-4270-a481-cc91be9a6d49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f201354df064bb6ad6c050d1dd460f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:14:36Z,use_quota=True,user_id='f07dd8b661dd4e5b899fd4b55c1d473c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:14:36 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f4cdca0a-ef74-40a4-ad52-085fe93724e5 tempest-ServersNegativeTestJSON-1348202369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f41509d8-85f7-42ea-acda-e7f0e4faf416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:14:36 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f4cdca0a-ef74-40a4-ad52-085fe93724e5 tempest-ServersNegativeTestJSON-1348202369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f41509d8-85f7-42ea-acda-e7f0e4faf416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:14:36 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f4cdca0a-ef74-40a4-ad52-085fe93724e5 tempest-ServersNegativeTestJSON-1348202369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1bf019c-0b17-4ccf-b3ba-d5cff938209b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:14:36 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f4cdca0a-ef74-40a4-ad52-085fe93724e5 tempest-ServersNegativeTestJSON-1348202369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1bf019c-0b17-4ccf-b3ba-d5cff938209b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec082cfc-902a-4270-a481-cc91be9a6d49', 'volume_name': 'volume-ec082cfc-902a-4270-a481-cc91be9a6d49', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:14:36 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f4cdca0a-ef74-40a4-ad52-085fe93724e5 tempest-ServersNegativeTestJSON-1348202369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20d02752-e485-46cd-8ca2-e49a8ade0db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:14:36 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f4cdca0a-ef74-40a4-ad52-085fe93724e5 tempest-ServersNegativeTestJSON-1348202369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20d02752-e485-46cd-8ca2-e49a8ade0db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:14:36 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f4cdca0a-ef74-40a4-ad52-085fe93724e5 tempest-ServersNegativeTestJSON-1348202369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10d28393-22b9-40e7-a399-9df8fa081018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:14:36 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-f4cdca0a-ef74-40a4-ad52-085fe93724e5 tempest-ServersNegativeTestJSON-1348202369 None] Volume ec082cfc-902a-4270-a481-cc91be9a6d49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec082cfc-902a-4270-a481-cc91be9a6d49', 'volume_size': 1} Apr 28 19:14:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f4cdca0a-ef74-40a4-ad52-085fe93724e5 tempest-ServersNegativeTestJSON-1348202369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:14:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f4cdca0a-ef74-40a4-ad52-085fe93724e5 tempest-ServersNegativeTestJSON-1348202369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:14:36 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f4cdca0a-ef74-40a4-ad52-085fe93724e5 tempest-ServersNegativeTestJSON-1348202369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-338282575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec082cfc-902a-4270-a481-cc91be9a6d49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f201354df064bb6ad6c050d1dd460f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:14:36Z,use_quota=True,user_id='f07dd8b661dd4e5b899fd4b55c1d473c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:14:36 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-f4cdca0a-ef74-40a4-ad52-085fe93724e5 tempest-ServersNegativeTestJSON-1348202369 None] Creating volume ec082cfc-902a-4270-a481-cc91be9a6d49 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:14:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f4cdca0a-ef74-40a4-ad52-085fe93724e5 tempest-ServersNegativeTestJSON-1348202369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:14:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f4cdca0a-ef74-40a4-ad52-085fe93724e5 tempest-ServersNegativeTestJSON-1348202369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:14:36 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f4cdca0a-ef74-40a4-ad52-085fe93724e5 tempest-ServersNegativeTestJSON-1348202369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:14:36 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f4cdca0a-ef74-40a4-ad52-085fe93724e5 tempest-ServersNegativeTestJSON-1348202369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:14:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f4cdca0a-ef74-40a4-ad52-085fe93724e5 tempest-ServersNegativeTestJSON-1348202369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:14:36 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f4cdca0a-ef74-40a4-ad52-085fe93724e5 tempest-ServersNegativeTestJSON-1348202369 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:14:36 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-f4cdca0a-ef74-40a4-ad52-085fe93724e5 tempest-ServersNegativeTestJSON-1348202369 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:14:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f4cdca0a-ef74-40a4-ad52-085fe93724e5 tempest-ServersNegativeTestJSON-1348202369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ec082cfc-902a-4270-a481-cc91be9a6d49 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:14:36 devstack sudo[85567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ec082cfc-902a-4270-a481-cc91be9a6d49 1073741824 Apr 28 19:14:36 devstack sudo[85567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:14:36 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8219ad0b-9c85-4e7e-82dc-d06976731883 tempest-ServerRescueNegativeTestJSON-1063303551 None] Acquiring lock "cinder-760f89ea-83c1-46e1-bd4e-4ed5a542c319-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:14:36 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8219ad0b-9c85-4e7e-82dc-d06976731883 tempest-ServerRescueNegativeTestJSON-1063303551 None] Lock "cinder-760f89ea-83c1-46e1-bd4e-4ed5a542c319-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:14:36 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8219ad0b-9c85-4e7e-82dc-d06976731883 tempest-ServerRescueNegativeTestJSON-1063303551 None] Acquiring lock "cinder-quobyte-760f89ea-83c1-46e1-bd4e-4ed5a542c319" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:14:36 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8219ad0b-9c85-4e7e-82dc-d06976731883 tempest-ServerRescueNegativeTestJSON-1063303551 None] Lock "cinder-quobyte-760f89ea-83c1-46e1-bd4e-4ed5a542c319" acquired by "delete_volume" :: waited 0.038s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:14:36 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4439a715-c798-462d-bb5d-be16a213b2fd]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:14:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8219ad0b-9c85-4e7e-82dc-d06976731883 tempest-ServerRescueNegativeTestJSON-1063303551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-760f89ea-83c1-46e1-bd4e-4ed5a542c319 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:14:37 devstack sudo[85569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-760f89ea-83c1-46e1-bd4e-4ed5a542c319 Apr 28 19:14:37 devstack sudo[85569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:14:37 devstack sudo[85567]: pam_unix(sudo:session): session closed for user root Apr 28 19:14:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f4cdca0a-ef74-40a4-ad52-085fe93724e5 tempest-ServersNegativeTestJSON-1348202369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ec082cfc-902a-4270-a481-cc91be9a6d49 1073741824" returned: 0 in 1.559s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:14:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f4cdca0a-ef74-40a4-ad52-085fe93724e5 tempest-ServersNegativeTestJSON-1348202369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ec082cfc-902a-4270-a481-cc91be9a6d49 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:14:37 devstack sudo[85577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ec082cfc-902a-4270-a481-cc91be9a6d49 Apr 28 19:14:37 devstack sudo[85577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:14:38 devstack sudo[85569]: pam_unix(sudo:session): session closed for user root Apr 28 19:14:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8219ad0b-9c85-4e7e-82dc-d06976731883 tempest-ServerRescueNegativeTestJSON-1063303551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-760f89ea-83c1-46e1-bd4e-4ed5a542c319" returned: 0 in 1.509s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:14:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8219ad0b-9c85-4e7e-82dc-d06976731883 tempest-ServerRescueNegativeTestJSON-1063303551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-760f89ea-83c1-46e1-bd4e-4ed5a542c319 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:14:38 devstack sudo[85582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-760f89ea-83c1-46e1-bd4e-4ed5a542c319 Apr 28 19:14:38 devstack sudo[85582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:14:39 devstack sudo[85577]: pam_unix(sudo:session): session closed for user root Apr 28 19:14:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f4cdca0a-ef74-40a4-ad52-085fe93724e5 tempest-ServersNegativeTestJSON-1348202369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ec082cfc-902a-4270-a481-cc91be9a6d49" returned: 0 in 1.052s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:14:39 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f4cdca0a-ef74-40a4-ad52-085fe93724e5 tempest-ServersNegativeTestJSON-1348202369 None] <== create_volume: return (2683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:14:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f4cdca0a-ef74-40a4-ad52-085fe93724e5 tempest-ServersNegativeTestJSON-1348202369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.685s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:14:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f4cdca0a-ef74-40a4-ad52-085fe93724e5 tempest-ServersNegativeTestJSON-1348202369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10d28393-22b9-40e7-a399-9df8fa081018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec082cfc-902a-4270-a481-cc91be9a6d49', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:14:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f4cdca0a-ef74-40a4-ad52-085fe93724e5 tempest-ServersNegativeTestJSON-1348202369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (673151ff-b54f-40c8-9066-3d3d692047bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:14:39 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-f4cdca0a-ef74-40a4-ad52-085fe93724e5 tempest-ServersNegativeTestJSON-1348202369 None] Volume volume-ec082cfc-902a-4270-a481-cc91be9a6d49 (ec082cfc-902a-4270-a481-cc91be9a6d49): created successfully Apr 28 19:14:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f4cdca0a-ef74-40a4-ad52-085fe93724e5 tempest-ServersNegativeTestJSON-1348202369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (673151ff-b54f-40c8-9066-3d3d692047bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:14:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f4cdca0a-ef74-40a4-ad52-085fe93724e5 tempest-ServersNegativeTestJSON-1348202369 None] Flow 'volume_create_manager' (0d3565ba-0f7a-4c8d-9325-9a08ca65d72c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:14:39 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-f4cdca0a-ef74-40a4-ad52-085fe93724e5 tempest-ServersNegativeTestJSON-1348202369 None] Created volume successfully. Apr 28 19:14:39 devstack sudo[85582]: pam_unix(sudo:session): session closed for user root Apr 28 19:14:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8219ad0b-9c85-4e7e-82dc-d06976731883 tempest-ServerRescueNegativeTestJSON-1063303551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-760f89ea-83c1-46e1-bd4e-4ed5a542c319" returned: 0 in 0.868s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:14:39 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8219ad0b-9c85-4e7e-82dc-d06976731883 tempest-ServerRescueNegativeTestJSON-1063303551 None] Lock "cinder-quobyte-760f89ea-83c1-46e1-bd4e-4ed5a542c319" released by "delete_volume" :: held 2.464s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:14:39 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-8219ad0b-9c85-4e7e-82dc-d06976731883 tempest-ServerRescueNegativeTestJSON-1063303551 None] Created reservations ['5e6e0abb-2cdc-4817-bf8c-b5b6ced6e8d3', '004d139b-272a-4021-9c2a-f15f966626c7', '6e4d76b9-409b-4814-8da1-a442914850b8', 'e2bfe1a0-7676-4ab3-be11-925e74a3fd27'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:14:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8219ad0b-9c85-4e7e-82dc-d06976731883 tempest-ServerRescueNegativeTestJSON-1063303551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:14:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8219ad0b-9c85-4e7e-82dc-d06976731883 tempest-ServerRescueNegativeTestJSON-1063303551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:14:39 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-8219ad0b-9c85-4e7e-82dc-d06976731883 tempest-ServerRescueNegativeTestJSON-1063303551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:14:39 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-8219ad0b-9c85-4e7e-82dc-d06976731883 tempest-ServerRescueNegativeTestJSON-1063303551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:14:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8219ad0b-9c85-4e7e-82dc-d06976731883 tempest-ServerRescueNegativeTestJSON-1063303551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:14:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8219ad0b-9c85-4e7e-82dc-d06976731883 tempest-ServerRescueNegativeTestJSON-1063303551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:14:39 devstack sudo[85586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:14:39 devstack sudo[85586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:14:40 devstack sudo[85586]: pam_unix(sudo:session): session closed for user root Apr 28 19:14:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8219ad0b-9c85-4e7e-82dc-d06976731883 tempest-ServerRescueNegativeTestJSON-1063303551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.808s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:14:40 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-8219ad0b-9c85-4e7e-82dc-d06976731883 tempest-ServerRescueNegativeTestJSON-1063303551 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:14:40 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-8219ad0b-9c85-4e7e-82dc-d06976731883 tempest-ServerRescueNegativeTestJSON-1063303551 None] Deleted volume successfully. Apr 28 19:14:40 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8219ad0b-9c85-4e7e-82dc-d06976731883 tempest-ServerRescueNegativeTestJSON-1063303551 None] Lock "cinder-760f89ea-83c1-46e1-bd4e-4ed5a542c319-delete_volume" released by "delete_volume" :: held 3.745s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:14:40 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-41d0578e-62ac-4f8c-9a15-2d625ec8f079 tempest-ServersNegativeTestJSON-1348202369 None] Acquiring lock "cinder-ec082cfc-902a-4270-a481-cc91be9a6d49-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:14:40 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-41d0578e-62ac-4f8c-9a15-2d625ec8f079 tempest-ServersNegativeTestJSON-1348202369 None] Lock "cinder-ec082cfc-902a-4270-a481-cc91be9a6d49-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:14:40 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-41d0578e-62ac-4f8c-9a15-2d625ec8f079 tempest-ServersNegativeTestJSON-1348202369 None] Acquiring lock "cinder-quobyte-ec082cfc-902a-4270-a481-cc91be9a6d49" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:14:40 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-41d0578e-62ac-4f8c-9a15-2d625ec8f079 tempest-ServersNegativeTestJSON-1348202369 None] Lock "cinder-quobyte-ec082cfc-902a-4270-a481-cc91be9a6d49" acquired by "delete_volume" :: waited 0.072s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:14:40 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[324e5858-c2e0-4bc2-9dad-9014f40896f5]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:14:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-41d0578e-62ac-4f8c-9a15-2d625ec8f079 tempest-ServersNegativeTestJSON-1348202369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ec082cfc-902a-4270-a481-cc91be9a6d49 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:14:40 devstack sudo[85593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ec082cfc-902a-4270-a481-cc91be9a6d49 Apr 28 19:14:40 devstack sudo[85593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:14:41 devstack sudo[85593]: pam_unix(sudo:session): session closed for user root Apr 28 19:14:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-41d0578e-62ac-4f8c-9a15-2d625ec8f079 tempest-ServersNegativeTestJSON-1348202369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ec082cfc-902a-4270-a481-cc91be9a6d49" returned: 0 in 1.205s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:14:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-41d0578e-62ac-4f8c-9a15-2d625ec8f079 tempest-ServersNegativeTestJSON-1348202369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ec082cfc-902a-4270-a481-cc91be9a6d49 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:14:41 devstack sudo[85624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ec082cfc-902a-4270-a481-cc91be9a6d49 Apr 28 19:14:41 devstack sudo[85624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:14:43 devstack sudo[85624]: pam_unix(sudo:session): session closed for user root Apr 28 19:14:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-41d0578e-62ac-4f8c-9a15-2d625ec8f079 tempest-ServersNegativeTestJSON-1348202369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ec082cfc-902a-4270-a481-cc91be9a6d49" returned: 0 in 1.142s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:14:43 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-41d0578e-62ac-4f8c-9a15-2d625ec8f079 tempest-ServersNegativeTestJSON-1348202369 None] Lock "cinder-quobyte-ec082cfc-902a-4270-a481-cc91be9a6d49" released by "delete_volume" :: held 2.461s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:14:43 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-41d0578e-62ac-4f8c-9a15-2d625ec8f079 tempest-ServersNegativeTestJSON-1348202369 None] Created reservations ['c873dd0e-1365-49e8-aa01-f20dd3857e78', '224c21ad-6037-4384-8f5d-adb2ce183b58', '9c4ab46b-3661-446e-a728-ee9bcea70d37', '43358b84-fa20-478e-b6e8-2c9964bace47'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:14:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-41d0578e-62ac-4f8c-9a15-2d625ec8f079 tempest-ServersNegativeTestJSON-1348202369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:14:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-41d0578e-62ac-4f8c-9a15-2d625ec8f079 tempest-ServersNegativeTestJSON-1348202369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:14:43 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-41d0578e-62ac-4f8c-9a15-2d625ec8f079 tempest-ServersNegativeTestJSON-1348202369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:14:43 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-41d0578e-62ac-4f8c-9a15-2d625ec8f079 tempest-ServersNegativeTestJSON-1348202369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:14:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-41d0578e-62ac-4f8c-9a15-2d625ec8f079 tempest-ServersNegativeTestJSON-1348202369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:14:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-41d0578e-62ac-4f8c-9a15-2d625ec8f079 tempest-ServersNegativeTestJSON-1348202369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:14:43 devstack sudo[85637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:14:43 devstack sudo[85637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:14:44 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5bf98bd9-2619-4a39-95e4-3ef3123b7c5c tempest-ServersNegativeTestJSON-1348202369 None] Acquiring lock "cinder-7d9f79d6-095a-4e7b-a428-61a1eda50155-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:14:44 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5bf98bd9-2619-4a39-95e4-3ef3123b7c5c tempest-ServersNegativeTestJSON-1348202369 None] Lock "cinder-7d9f79d6-095a-4e7b-a428-61a1eda50155-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:14:44 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5bf98bd9-2619-4a39-95e4-3ef3123b7c5c tempest-ServersNegativeTestJSON-1348202369 None] Acquiring lock "cinder-quobyte-7d9f79d6-095a-4e7b-a428-61a1eda50155" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:14:44 devstack sudo[85637]: pam_unix(sudo:session): session closed for user root Apr 28 19:14:44 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5bf98bd9-2619-4a39-95e4-3ef3123b7c5c tempest-ServersNegativeTestJSON-1348202369 None] Lock "cinder-quobyte-7d9f79d6-095a-4e7b-a428-61a1eda50155" acquired by "delete_volume" :: waited 0.043s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:14:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-41d0578e-62ac-4f8c-9a15-2d625ec8f079 tempest-ServersNegativeTestJSON-1348202369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 1.201s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:14:44 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-41d0578e-62ac-4f8c-9a15-2d625ec8f079 tempest-ServersNegativeTestJSON-1348202369 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:14:44 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-41d0578e-62ac-4f8c-9a15-2d625ec8f079 tempest-ServersNegativeTestJSON-1348202369 None] Deleted volume successfully. Apr 28 19:14:44 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf2db62-23bf-4fc9-8a4e-377b0e510a10]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:14:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5bf98bd9-2619-4a39-95e4-3ef3123b7c5c tempest-ServersNegativeTestJSON-1348202369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7d9f79d6-095a-4e7b-a428-61a1eda50155 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:14:44 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-41d0578e-62ac-4f8c-9a15-2d625ec8f079 tempest-ServersNegativeTestJSON-1348202369 None] Lock "cinder-ec082cfc-902a-4270-a481-cc91be9a6d49-delete_volume" released by "delete_volume" :: held 4.164s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:14:44 devstack sudo[85641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7d9f79d6-095a-4e7b-a428-61a1eda50155 Apr 28 19:14:44 devstack sudo[85641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:14:46 devstack sudo[85641]: pam_unix(sudo:session): session closed for user root Apr 28 19:14:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5bf98bd9-2619-4a39-95e4-3ef3123b7c5c tempest-ServersNegativeTestJSON-1348202369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7d9f79d6-095a-4e7b-a428-61a1eda50155" returned: 0 in 1.574s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:14:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5bf98bd9-2619-4a39-95e4-3ef3123b7c5c tempest-ServersNegativeTestJSON-1348202369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7d9f79d6-095a-4e7b-a428-61a1eda50155 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:14:46 devstack sudo[85656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7d9f79d6-095a-4e7b-a428-61a1eda50155 Apr 28 19:14:46 devstack sudo[85656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:14:47 devstack sudo[85656]: pam_unix(sudo:session): session closed for user root Apr 28 19:14:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5bf98bd9-2619-4a39-95e4-3ef3123b7c5c tempest-ServersNegativeTestJSON-1348202369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7d9f79d6-095a-4e7b-a428-61a1eda50155" returned: 0 in 1.028s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:14:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5bf98bd9-2619-4a39-95e4-3ef3123b7c5c tempest-ServersNegativeTestJSON-1348202369 None] Lock "cinder-quobyte-7d9f79d6-095a-4e7b-a428-61a1eda50155" released by "delete_volume" :: held 2.678s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:14:47 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-5bf98bd9-2619-4a39-95e4-3ef3123b7c5c tempest-ServersNegativeTestJSON-1348202369 None] Created reservations ['aa81e270-4d99-4863-b873-0432090f23d3', '65f4ad18-5ffa-4203-a24c-36eb0e9e78fc', '87920e54-8036-4a92-93f1-f42105946b66', 'de7c4502-d872-4129-9ed3-654afe742de8'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:14:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5bf98bd9-2619-4a39-95e4-3ef3123b7c5c tempest-ServersNegativeTestJSON-1348202369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:14:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5bf98bd9-2619-4a39-95e4-3ef3123b7c5c tempest-ServersNegativeTestJSON-1348202369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:14:47 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5bf98bd9-2619-4a39-95e4-3ef3123b7c5c tempest-ServersNegativeTestJSON-1348202369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:14:47 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5bf98bd9-2619-4a39-95e4-3ef3123b7c5c tempest-ServersNegativeTestJSON-1348202369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:14:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5bf98bd9-2619-4a39-95e4-3ef3123b7c5c tempest-ServersNegativeTestJSON-1348202369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:14:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5bf98bd9-2619-4a39-95e4-3ef3123b7c5c tempest-ServersNegativeTestJSON-1348202369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:14:47 devstack sudo[85660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:14:47 devstack sudo[85660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:14:48 devstack sudo[85660]: pam_unix(sudo:session): session closed for user root Apr 28 19:14:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5bf98bd9-2619-4a39-95e4-3ef3123b7c5c tempest-ServersNegativeTestJSON-1348202369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.889s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:14:48 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-5bf98bd9-2619-4a39-95e4-3ef3123b7c5c tempest-ServersNegativeTestJSON-1348202369 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:14:48 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-5bf98bd9-2619-4a39-95e4-3ef3123b7c5c tempest-ServersNegativeTestJSON-1348202369 None] Deleted volume successfully. Apr 28 19:14:48 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5bf98bd9-2619-4a39-95e4-3ef3123b7c5c tempest-ServersNegativeTestJSON-1348202369 None] Lock "cinder-7d9f79d6-095a-4e7b-a428-61a1eda50155-delete_volume" released by "delete_volume" :: held 3.966s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:14:52 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-c29795ab-2839-470d-8677-ff789a8464c4 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:14:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c29795ab-2839-470d-8677-ff789a8464c4 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Flow 'volume_create_manager' (3a64f2a3-ddfa-4e28-8a06-76eafc8fdbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:14:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c29795ab-2839-470d-8677-ff789a8464c4 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0418fd1-a36e-4ff9-974d-72ce1608bd36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:14:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c29795ab-2839-470d-8677-ff789a8464c4 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0418fd1-a36e-4ff9-974d-72ce1608bd36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-113923666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1333cba7-b2d1-429b-8541-97207558c33a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da03cc9ac2ca480086a1e0b2afa89fa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:14:53Z,use_quota=True,user_id='1329e578582d42fe873ab503fa6aec2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:14:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c29795ab-2839-470d-8677-ff789a8464c4 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73fe2570-06b3-4037-8a8b-1d5ed517c500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:14:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c29795ab-2839-470d-8677-ff789a8464c4 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73fe2570-06b3-4037-8a8b-1d5ed517c500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:14:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c29795ab-2839-470d-8677-ff789a8464c4 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f14ec15e-630c-4550-8efe-51ba61c0e0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:14:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c29795ab-2839-470d-8677-ff789a8464c4 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f14ec15e-630c-4550-8efe-51ba61c0e0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1333cba7-b2d1-429b-8541-97207558c33a', 'volume_name': 'volume-1333cba7-b2d1-429b-8541-97207558c33a', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:14:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c29795ab-2839-470d-8677-ff789a8464c4 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f45bfc5d-de20-47fa-a0ba-fbff5a6c7337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:14:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c29795ab-2839-470d-8677-ff789a8464c4 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f45bfc5d-de20-47fa-a0ba-fbff5a6c7337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:14:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c29795ab-2839-470d-8677-ff789a8464c4 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd99860c-15a7-40b7-a93a-1fc165df3d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:14:52 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-c29795ab-2839-470d-8677-ff789a8464c4 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Volume 1333cba7-b2d1-429b-8541-97207558c33a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1333cba7-b2d1-429b-8541-97207558c33a', 'volume_size': 1} Apr 28 19:14:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c29795ab-2839-470d-8677-ff789a8464c4 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:14:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c29795ab-2839-470d-8677-ff789a8464c4 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:14:52 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c29795ab-2839-470d-8677-ff789a8464c4 tempest-VolumeQuotasAdminTestJSON-2027301360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-113923666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1333cba7-b2d1-429b-8541-97207558c33a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da03cc9ac2ca480086a1e0b2afa89fa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:14:53Z,use_quota=True,user_id='1329e578582d42fe873ab503fa6aec2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:14:52 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-c29795ab-2839-470d-8677-ff789a8464c4 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Creating volume 1333cba7-b2d1-429b-8541-97207558c33a {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:14:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c29795ab-2839-470d-8677-ff789a8464c4 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:14:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c29795ab-2839-470d-8677-ff789a8464c4 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:14:52 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c29795ab-2839-470d-8677-ff789a8464c4 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:14:52 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c29795ab-2839-470d-8677-ff789a8464c4 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:14:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c29795ab-2839-470d-8677-ff789a8464c4 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:14:52 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c29795ab-2839-470d-8677-ff789a8464c4 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:14:52 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-c29795ab-2839-470d-8677-ff789a8464c4 tempest-VolumeQuotasAdminTestJSON-2027301360 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:14:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c29795ab-2839-470d-8677-ff789a8464c4 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1333cba7-b2d1-429b-8541-97207558c33a 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:14:52 devstack sudo[85755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1333cba7-b2d1-429b-8541-97207558c33a 1073741824 Apr 28 19:14:52 devstack sudo[85755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:14:53 devstack sudo[85755]: pam_unix(sudo:session): session closed for user root Apr 28 19:14:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c29795ab-2839-470d-8677-ff789a8464c4 tempest-VolumeQuotasAdminTestJSON-2027301360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1333cba7-b2d1-429b-8541-97207558c33a 1073741824" returned: 0 in 0.974s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:14:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c29795ab-2839-470d-8677-ff789a8464c4 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1333cba7-b2d1-429b-8541-97207558c33a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:14:53 devstack sudo[85762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1333cba7-b2d1-429b-8541-97207558c33a Apr 28 19:14:53 devstack sudo[85762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:14:54 devstack sudo[85762]: pam_unix(sudo:session): session closed for user root Apr 28 19:14:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c29795ab-2839-470d-8677-ff789a8464c4 tempest-VolumeQuotasAdminTestJSON-2027301360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1333cba7-b2d1-429b-8541-97207558c33a" returned: 0 in 0.623s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:14:54 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c29795ab-2839-470d-8677-ff789a8464c4 tempest-VolumeQuotasAdminTestJSON-2027301360 None] <== create_volume: return (1641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:14:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c29795ab-2839-470d-8677-ff789a8464c4 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:14:54 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c29795ab-2839-470d-8677-ff789a8464c4 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd99860c-15a7-40b7-a93a-1fc165df3d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1333cba7-b2d1-429b-8541-97207558c33a', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:14:54 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c29795ab-2839-470d-8677-ff789a8464c4 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f876595-de9b-4b39-bfb4-08f06b813023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:14:54 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-c29795ab-2839-470d-8677-ff789a8464c4 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Volume volume-1333cba7-b2d1-429b-8541-97207558c33a (1333cba7-b2d1-429b-8541-97207558c33a): created successfully Apr 28 19:14:54 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c29795ab-2839-470d-8677-ff789a8464c4 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f876595-de9b-4b39-bfb4-08f06b813023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:14:54 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c29795ab-2839-470d-8677-ff789a8464c4 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Flow 'volume_create_manager' (3a64f2a3-ddfa-4e28-8a06-76eafc8fdbd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:14:54 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-c29795ab-2839-470d-8677-ff789a8464c4 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Created volume successfully. Apr 28 19:14:54 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e60d40ab-2aa5-4b41-a629-4fd04c18d274 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Acquiring lock "cinder-1333cba7-b2d1-429b-8541-97207558c33a-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:14:54 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e60d40ab-2aa5-4b41-a629-4fd04c18d274 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Lock "cinder-1333cba7-b2d1-429b-8541-97207558c33a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:14:54 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e60d40ab-2aa5-4b41-a629-4fd04c18d274 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Acquiring lock "cinder-quobyte-1333cba7-b2d1-429b-8541-97207558c33a" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:14:54 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e60d40ab-2aa5-4b41-a629-4fd04c18d274 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Lock "cinder-quobyte-1333cba7-b2d1-429b-8541-97207558c33a" acquired by "delete_volume" :: waited 0.014s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:14:54 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d824a91-a6fb-4107-99c4-a834e76400aa]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:14:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e60d40ab-2aa5-4b41-a629-4fd04c18d274 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1333cba7-b2d1-429b-8541-97207558c33a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:14:55 devstack sudo[85765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1333cba7-b2d1-429b-8541-97207558c33a Apr 28 19:14:55 devstack sudo[85765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:14:55 devstack sudo[85765]: pam_unix(sudo:session): session closed for user root Apr 28 19:14:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e60d40ab-2aa5-4b41-a629-4fd04c18d274 tempest-VolumeQuotasAdminTestJSON-2027301360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1333cba7-b2d1-429b-8541-97207558c33a" returned: 0 in 0.823s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:14:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e60d40ab-2aa5-4b41-a629-4fd04c18d274 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1333cba7-b2d1-429b-8541-97207558c33a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:14:55 devstack sudo[85770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1333cba7-b2d1-429b-8541-97207558c33a Apr 28 19:14:55 devstack sudo[85770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:14:56 devstack sudo[85770]: pam_unix(sudo:session): session closed for user root Apr 28 19:14:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e60d40ab-2aa5-4b41-a629-4fd04c18d274 tempest-VolumeQuotasAdminTestJSON-2027301360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1333cba7-b2d1-429b-8541-97207558c33a" returned: 0 in 0.636s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:14:56 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e60d40ab-2aa5-4b41-a629-4fd04c18d274 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Lock "cinder-quobyte-1333cba7-b2d1-429b-8541-97207558c33a" released by "delete_volume" :: held 1.507s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:14:56 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-e60d40ab-2aa5-4b41-a629-4fd04c18d274 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Created reservations ['48257599-4869-4646-8f52-42b7e56b741b', 'c911ac78-5840-4944-bf0a-2b10ef5cd6eb', '2c68523a-2e7c-435f-a0d4-9c26500398d0', '07853c4c-0206-48e9-a7ed-d53a7aa9d75b'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:14:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e60d40ab-2aa5-4b41-a629-4fd04c18d274 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:14:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e60d40ab-2aa5-4b41-a629-4fd04c18d274 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:14:56 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-e60d40ab-2aa5-4b41-a629-4fd04c18d274 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:14:56 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-e60d40ab-2aa5-4b41-a629-4fd04c18d274 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:14:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e60d40ab-2aa5-4b41-a629-4fd04c18d274 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:14:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e60d40ab-2aa5-4b41-a629-4fd04c18d274 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:14:56 devstack sudo[85773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:14:56 devstack sudo[85773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:14:57 devstack sudo[85773]: pam_unix(sudo:session): session closed for user root Apr 28 19:14:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e60d40ab-2aa5-4b41-a629-4fd04c18d274 tempest-VolumeQuotasAdminTestJSON-2027301360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.803s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:14:57 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-e60d40ab-2aa5-4b41-a629-4fd04c18d274 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:14:57 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-e60d40ab-2aa5-4b41-a629-4fd04c18d274 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Deleted volume successfully. Apr 28 19:14:57 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e60d40ab-2aa5-4b41-a629-4fd04c18d274 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Lock "cinder-1333cba7-b2d1-429b-8541-97207558c33a-delete_volume" released by "delete_volume" :: held 2.510s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:14:57 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-225ac1a5-cb62-4931-b83b-4c0601eabbf7 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:14:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-225ac1a5-cb62-4931-b83b-4c0601eabbf7 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Flow 'volume_create_manager' (8ba3bf91-94a2-4845-8067-20f95aa89089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:14:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-225ac1a5-cb62-4931-b83b-4c0601eabbf7 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (289ca955-8e64-408b-9867-d7a808087fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:14:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-225ac1a5-cb62-4931-b83b-4c0601eabbf7 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (289ca955-8e64-408b-9867-d7a808087fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2062045748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0d7de0e-8faa-472f-932d-ce20cca03e39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da03cc9ac2ca480086a1e0b2afa89fa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:14:58Z,use_quota=True,user_id='1329e578582d42fe873ab503fa6aec2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:14:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-225ac1a5-cb62-4931-b83b-4c0601eabbf7 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c833c72-0d5d-485d-a348-8b578d5a41fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:14:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-225ac1a5-cb62-4931-b83b-4c0601eabbf7 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c833c72-0d5d-485d-a348-8b578d5a41fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:14:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-225ac1a5-cb62-4931-b83b-4c0601eabbf7 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8104ce88-2039-44b8-80a3-c2f7661f4a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:14:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-225ac1a5-cb62-4931-b83b-4c0601eabbf7 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8104ce88-2039-44b8-80a3-c2f7661f4a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0d7de0e-8faa-472f-932d-ce20cca03e39', 'volume_name': 'volume-a0d7de0e-8faa-472f-932d-ce20cca03e39', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:14:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-225ac1a5-cb62-4931-b83b-4c0601eabbf7 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7917cebb-8e0c-4921-bba0-beff3cfe7906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:14:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-225ac1a5-cb62-4931-b83b-4c0601eabbf7 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7917cebb-8e0c-4921-bba0-beff3cfe7906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:14:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-225ac1a5-cb62-4931-b83b-4c0601eabbf7 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc0ba071-e1ac-4aea-bdab-cb5084289a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:14:57 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-225ac1a5-cb62-4931-b83b-4c0601eabbf7 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Volume a0d7de0e-8faa-472f-932d-ce20cca03e39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0d7de0e-8faa-472f-932d-ce20cca03e39', 'volume_size': 1} Apr 28 19:14:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-225ac1a5-cb62-4931-b83b-4c0601eabbf7 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:14:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-225ac1a5-cb62-4931-b83b-4c0601eabbf7 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:14:57 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-225ac1a5-cb62-4931-b83b-4c0601eabbf7 tempest-VolumeQuotasAdminTestJSON-2027301360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2062045748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0d7de0e-8faa-472f-932d-ce20cca03e39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da03cc9ac2ca480086a1e0b2afa89fa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:14:58Z,use_quota=True,user_id='1329e578582d42fe873ab503fa6aec2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:14:57 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-225ac1a5-cb62-4931-b83b-4c0601eabbf7 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Creating volume a0d7de0e-8faa-472f-932d-ce20cca03e39 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:14:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-225ac1a5-cb62-4931-b83b-4c0601eabbf7 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:14:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-225ac1a5-cb62-4931-b83b-4c0601eabbf7 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:14:57 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-225ac1a5-cb62-4931-b83b-4c0601eabbf7 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:14:57 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-225ac1a5-cb62-4931-b83b-4c0601eabbf7 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:14:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-225ac1a5-cb62-4931-b83b-4c0601eabbf7 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:14:57 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-225ac1a5-cb62-4931-b83b-4c0601eabbf7 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:14:57 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-225ac1a5-cb62-4931-b83b-4c0601eabbf7 tempest-VolumeQuotasAdminTestJSON-2027301360 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:14:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-225ac1a5-cb62-4931-b83b-4c0601eabbf7 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a0d7de0e-8faa-472f-932d-ce20cca03e39 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:14:57 devstack sudo[85777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a0d7de0e-8faa-472f-932d-ce20cca03e39 1073741824 Apr 28 19:14:57 devstack sudo[85777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:14:58 devstack sudo[85777]: pam_unix(sudo:session): session closed for user root Apr 28 19:14:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-225ac1a5-cb62-4931-b83b-4c0601eabbf7 tempest-VolumeQuotasAdminTestJSON-2027301360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a0d7de0e-8faa-472f-932d-ce20cca03e39 1073741824" returned: 0 in 0.863s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:14:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-225ac1a5-cb62-4931-b83b-4c0601eabbf7 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a0d7de0e-8faa-472f-932d-ce20cca03e39 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:14:58 devstack sudo[85784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a0d7de0e-8faa-472f-932d-ce20cca03e39 Apr 28 19:14:58 devstack sudo[85784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:14:59 devstack sudo[85784]: pam_unix(sudo:session): session closed for user root Apr 28 19:14:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-225ac1a5-cb62-4931-b83b-4c0601eabbf7 tempest-VolumeQuotasAdminTestJSON-2027301360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a0d7de0e-8faa-472f-932d-ce20cca03e39" returned: 0 in 0.677s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:14:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-225ac1a5-cb62-4931-b83b-4c0601eabbf7 tempest-VolumeQuotasAdminTestJSON-2027301360 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:14:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-225ac1a5-cb62-4931-b83b-4c0601eabbf7 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.589s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:14:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-225ac1a5-cb62-4931-b83b-4c0601eabbf7 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc0ba071-e1ac-4aea-bdab-cb5084289a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0d7de0e-8faa-472f-932d-ce20cca03e39', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:14:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-225ac1a5-cb62-4931-b83b-4c0601eabbf7 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f1701f5-7720-4c9d-95b9-64fa04e7bac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:14:59 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-225ac1a5-cb62-4931-b83b-4c0601eabbf7 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Volume volume-a0d7de0e-8faa-472f-932d-ce20cca03e39 (a0d7de0e-8faa-472f-932d-ce20cca03e39): created successfully Apr 28 19:14:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-225ac1a5-cb62-4931-b83b-4c0601eabbf7 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f1701f5-7720-4c9d-95b9-64fa04e7bac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:14:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-225ac1a5-cb62-4931-b83b-4c0601eabbf7 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Flow 'volume_create_manager' (8ba3bf91-94a2-4845-8067-20f95aa89089) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:14:59 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-225ac1a5-cb62-4931-b83b-4c0601eabbf7 tempest-VolumeQuotasAdminTestJSON-2027301360 None] Created volume successfully. Apr 28 19:15:00 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-8c4765dd-294c-4825-8047-206f8572d6f1 tempest-VolumeQuotasAdminTestJSON-808482167 None] Transfer volume completed successfully. Apr 28 19:15:01 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e17acfbb-5cb5-420d-be95-09f2bab38e47 tempest-VolumeQuotasAdminTestJSON-1137498093 None] Acquiring lock "cinder-a0d7de0e-8faa-472f-932d-ce20cca03e39-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:15:01 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e17acfbb-5cb5-420d-be95-09f2bab38e47 tempest-VolumeQuotasAdminTestJSON-1137498093 None] Lock "cinder-a0d7de0e-8faa-472f-932d-ce20cca03e39-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:15:01 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e17acfbb-5cb5-420d-be95-09f2bab38e47 tempest-VolumeQuotasAdminTestJSON-1137498093 None] Acquiring lock "cinder-quobyte-a0d7de0e-8faa-472f-932d-ce20cca03e39" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:15:01 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e17acfbb-5cb5-420d-be95-09f2bab38e47 tempest-VolumeQuotasAdminTestJSON-1137498093 None] Lock "cinder-quobyte-a0d7de0e-8faa-472f-932d-ce20cca03e39" acquired by "delete_volume" :: waited 0.018s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:15:01 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d3c42f-48ff-4417-8935-2ff97da287e8]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:15:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e17acfbb-5cb5-420d-be95-09f2bab38e47 tempest-VolumeQuotasAdminTestJSON-1137498093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a0d7de0e-8faa-472f-932d-ce20cca03e39 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:02 devstack sudo[85793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a0d7de0e-8faa-472f-932d-ce20cca03e39 Apr 28 19:15:02 devstack sudo[85793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:02 devstack sudo[85793]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e17acfbb-5cb5-420d-be95-09f2bab38e47 tempest-VolumeQuotasAdminTestJSON-1137498093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a0d7de0e-8faa-472f-932d-ce20cca03e39" returned: 0 in 0.854s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e17acfbb-5cb5-420d-be95-09f2bab38e47 tempest-VolumeQuotasAdminTestJSON-1137498093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a0d7de0e-8faa-472f-932d-ce20cca03e39 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:02 devstack sudo[85799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a0d7de0e-8faa-472f-932d-ce20cca03e39 Apr 28 19:15:02 devstack sudo[85799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:03 devstack cinder-volume[83863]: DEBUG oslo_service.periodic_task [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 28 19:15:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:15:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:15:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:15:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:15:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:15:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:03 devstack sudo[85803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:15:03 devstack sudo[85803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:03 devstack sudo[85799]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e17acfbb-5cb5-420d-be95-09f2bab38e47 tempest-VolumeQuotasAdminTestJSON-1137498093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a0d7de0e-8faa-472f-932d-ce20cca03e39" returned: 0 in 0.753s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e17acfbb-5cb5-420d-be95-09f2bab38e47 tempest-VolumeQuotasAdminTestJSON-1137498093 None] Lock "cinder-quobyte-a0d7de0e-8faa-472f-932d-ce20cca03e39" released by "delete_volume" :: held 1.686s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:15:03 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-e17acfbb-5cb5-420d-be95-09f2bab38e47 tempest-VolumeQuotasAdminTestJSON-1137498093 None] Created reservations ['d0581f3d-0209-4fbc-b913-f360e6fdafc4', '4b3336b4-d1e5-4946-abac-7063f3cb1bb2', 'eb26d56e-6558-4ee9-a358-b4afa66d8cd5', '1926e34e-b79b-4b2d-8ea4-565f1238b507'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:15:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e17acfbb-5cb5-420d-be95-09f2bab38e47 tempest-VolumeQuotasAdminTestJSON-1137498093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:15:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e17acfbb-5cb5-420d-be95-09f2bab38e47 tempest-VolumeQuotasAdminTestJSON-1137498093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:15:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-e17acfbb-5cb5-420d-be95-09f2bab38e47 tempest-VolumeQuotasAdminTestJSON-1137498093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:15:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-e17acfbb-5cb5-420d-be95-09f2bab38e47 tempest-VolumeQuotasAdminTestJSON-1137498093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:15:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e17acfbb-5cb5-420d-be95-09f2bab38e47 tempest-VolumeQuotasAdminTestJSON-1137498093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:15:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e17acfbb-5cb5-420d-be95-09f2bab38e47 tempest-VolumeQuotasAdminTestJSON-1137498093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:03 devstack sudo[85805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:15:03 devstack sudo[85805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:04 devstack sudo[85803]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 1.267s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:04 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:15:04 devstack sudo[85805]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e17acfbb-5cb5-420d-be95-09f2bab38e47 tempest-VolumeQuotasAdminTestJSON-1137498093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 1.214s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:04 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-e17acfbb-5cb5-420d-be95-09f2bab38e47 tempest-VolumeQuotasAdminTestJSON-1137498093 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:15:04 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-e17acfbb-5cb5-420d-be95-09f2bab38e47 tempest-VolumeQuotasAdminTestJSON-1137498093 None] Deleted volume successfully. Apr 28 19:15:04 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e17acfbb-5cb5-420d-be95-09f2bab38e47 tempest-VolumeQuotasAdminTestJSON-1137498093 None] Lock "cinder-a0d7de0e-8faa-472f-932d-ce20cca03e39-delete_volume" released by "delete_volume" :: held 3.222s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:15:08 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [req-90157d53-03a6-41eb-86e4-981ff5d06f7f req-040c8307-9bd4-437d-9419-00d62a43db0a tempest-VolumesSnapshotsTestJSON-594614211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:15:08 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-90157d53-03a6-41eb-86e4-981ff5d06f7f req-040c8307-9bd4-437d-9419-00d62a43db0a tempest-VolumesSnapshotsTestJSON-594614211 None] Flow 'volume_create_manager' (8b043112-d8cc-4d01-b3ed-d26a3bf996e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:15:08 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-90157d53-03a6-41eb-86e4-981ff5d06f7f req-040c8307-9bd4-437d-9419-00d62a43db0a tempest-VolumesSnapshotsTestJSON-594614211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c569aa0-c69c-444d-addd-c923d5d05d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:08 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-90157d53-03a6-41eb-86e4-981ff5d06f7f req-040c8307-9bd4-437d-9419-00d62a43db0a tempest-VolumesSnapshotsTestJSON-594614211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c569aa0-c69c-444d-addd-c923d5d05d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:15:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-116067502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=954b0ea2-5d2a-49f1-b680-025426cbe526,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43573c51dea44c188be92469c2de825f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:15:09Z,use_quota=True,user_id='615fee78b57a463ba7d5cda1bc317971',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:08 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-90157d53-03a6-41eb-86e4-981ff5d06f7f req-040c8307-9bd4-437d-9419-00d62a43db0a tempest-VolumesSnapshotsTestJSON-594614211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b00ee641-d4d2-4c8d-a0b3-df49ae607c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:08 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-90157d53-03a6-41eb-86e4-981ff5d06f7f req-040c8307-9bd4-437d-9419-00d62a43db0a tempest-VolumesSnapshotsTestJSON-594614211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b00ee641-d4d2-4c8d-a0b3-df49ae607c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:08 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-90157d53-03a6-41eb-86e4-981ff5d06f7f req-040c8307-9bd4-437d-9419-00d62a43db0a tempest-VolumesSnapshotsTestJSON-594614211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28674f12-f295-4644-9be2-aa302a22caac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:08 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-90157d53-03a6-41eb-86e4-981ff5d06f7f req-040c8307-9bd4-437d-9419-00d62a43db0a tempest-VolumesSnapshotsTestJSON-594614211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28674f12-f295-4644-9be2-aa302a22caac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '954b0ea2-5d2a-49f1-b680-025426cbe526', 'volume_name': 'volume-954b0ea2-5d2a-49f1-b680-025426cbe526', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:08 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-90157d53-03a6-41eb-86e4-981ff5d06f7f req-040c8307-9bd4-437d-9419-00d62a43db0a tempest-VolumesSnapshotsTestJSON-594614211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c0d2776-b354-4141-a2ff-226a070d3924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:08 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-90157d53-03a6-41eb-86e4-981ff5d06f7f req-040c8307-9bd4-437d-9419-00d62a43db0a tempest-VolumesSnapshotsTestJSON-594614211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c0d2776-b354-4141-a2ff-226a070d3924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:08 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-90157d53-03a6-41eb-86e4-981ff5d06f7f req-040c8307-9bd4-437d-9419-00d62a43db0a tempest-VolumesSnapshotsTestJSON-594614211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8598373-3380-47e8-80c4-b8e84ad6fb3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:08 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [req-90157d53-03a6-41eb-86e4-981ff5d06f7f req-040c8307-9bd4-437d-9419-00d62a43db0a tempest-VolumesSnapshotsTestJSON-594614211 None] Volume 954b0ea2-5d2a-49f1-b680-025426cbe526: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-954b0ea2-5d2a-49f1-b680-025426cbe526', 'volume_size': 1} Apr 28 19:15:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-90157d53-03a6-41eb-86e4-981ff5d06f7f req-040c8307-9bd4-437d-9419-00d62a43db0a tempest-VolumesSnapshotsTestJSON-594614211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:15:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-90157d53-03a6-41eb-86e4-981ff5d06f7f req-040c8307-9bd4-437d-9419-00d62a43db0a tempest-VolumesSnapshotsTestJSON-594614211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:15:08 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-90157d53-03a6-41eb-86e4-981ff5d06f7f req-040c8307-9bd4-437d-9419-00d62a43db0a tempest-VolumesSnapshotsTestJSON-594614211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:15:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-116067502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=954b0ea2-5d2a-49f1-b680-025426cbe526,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43573c51dea44c188be92469c2de825f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:15:09Z,use_quota=True,user_id='615fee78b57a463ba7d5cda1bc317971',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:15:08 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [req-90157d53-03a6-41eb-86e4-981ff5d06f7f req-040c8307-9bd4-437d-9419-00d62a43db0a tempest-VolumesSnapshotsTestJSON-594614211 None] Creating volume 954b0ea2-5d2a-49f1-b680-025426cbe526 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:15:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-90157d53-03a6-41eb-86e4-981ff5d06f7f req-040c8307-9bd4-437d-9419-00d62a43db0a tempest-VolumesSnapshotsTestJSON-594614211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:15:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-90157d53-03a6-41eb-86e4-981ff5d06f7f req-040c8307-9bd4-437d-9419-00d62a43db0a tempest-VolumesSnapshotsTestJSON-594614211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:15:08 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-90157d53-03a6-41eb-86e4-981ff5d06f7f req-040c8307-9bd4-437d-9419-00d62a43db0a tempest-VolumesSnapshotsTestJSON-594614211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:15:08 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-90157d53-03a6-41eb-86e4-981ff5d06f7f req-040c8307-9bd4-437d-9419-00d62a43db0a tempest-VolumesSnapshotsTestJSON-594614211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:15:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-90157d53-03a6-41eb-86e4-981ff5d06f7f req-040c8307-9bd4-437d-9419-00d62a43db0a tempest-VolumesSnapshotsTestJSON-594614211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:15:08 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-90157d53-03a6-41eb-86e4-981ff5d06f7f req-040c8307-9bd4-437d-9419-00d62a43db0a tempest-VolumesSnapshotsTestJSON-594614211 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:15:08 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [req-90157d53-03a6-41eb-86e4-981ff5d06f7f req-040c8307-9bd4-437d-9419-00d62a43db0a tempest-VolumesSnapshotsTestJSON-594614211 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:15:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-90157d53-03a6-41eb-86e4-981ff5d06f7f req-040c8307-9bd4-437d-9419-00d62a43db0a tempest-VolumesSnapshotsTestJSON-594614211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-954b0ea2-5d2a-49f1-b680-025426cbe526 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:08 devstack sudo[85815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-954b0ea2-5d2a-49f1-b680-025426cbe526 1073741824 Apr 28 19:15:08 devstack sudo[85815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:09 devstack sudo[85815]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-90157d53-03a6-41eb-86e4-981ff5d06f7f req-040c8307-9bd4-437d-9419-00d62a43db0a tempest-VolumesSnapshotsTestJSON-594614211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-954b0ea2-5d2a-49f1-b680-025426cbe526 1073741824" returned: 0 in 0.919s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-90157d53-03a6-41eb-86e4-981ff5d06f7f req-040c8307-9bd4-437d-9419-00d62a43db0a tempest-VolumesSnapshotsTestJSON-594614211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-954b0ea2-5d2a-49f1-b680-025426cbe526 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:09 devstack sudo[85823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-954b0ea2-5d2a-49f1-b680-025426cbe526 Apr 28 19:15:09 devstack sudo[85823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3d141717-e8b0-4ef9-84fd-41a125c43da2 tempest-BackendsCapabilitiesAdminTestsJSON-437138559 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6508674621582, 'free_capacity_gb': 1775.6508674621582, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83863) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 28 19:15:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5449f74f-3207-45d7-88f3-fba978082477 tempest-BackendsCapabilitiesAdminTestsJSON-437138559 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6508674621582, 'free_capacity_gb': 1775.6508674621582, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83863) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 28 19:15:10 devstack sudo[85823]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-90157d53-03a6-41eb-86e4-981ff5d06f7f req-040c8307-9bd4-437d-9419-00d62a43db0a tempest-VolumesSnapshotsTestJSON-594614211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-954b0ea2-5d2a-49f1-b680-025426cbe526" returned: 0 in 0.685s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:10 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-90157d53-03a6-41eb-86e4-981ff5d06f7f req-040c8307-9bd4-437d-9419-00d62a43db0a tempest-VolumesSnapshotsTestJSON-594614211 None] <== create_volume: return (1656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:15:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-90157d53-03a6-41eb-86e4-981ff5d06f7f req-040c8307-9bd4-437d-9419-00d62a43db0a tempest-VolumesSnapshotsTestJSON-594614211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.658s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:15:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-90157d53-03a6-41eb-86e4-981ff5d06f7f req-040c8307-9bd4-437d-9419-00d62a43db0a tempest-VolumesSnapshotsTestJSON-594614211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8598373-3380-47e8-80c4-b8e84ad6fb3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-954b0ea2-5d2a-49f1-b680-025426cbe526', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-90157d53-03a6-41eb-86e4-981ff5d06f7f req-040c8307-9bd4-437d-9419-00d62a43db0a tempest-VolumesSnapshotsTestJSON-594614211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b45ae73-3f20-40ab-8aa6-6227827bf710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:10 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [req-90157d53-03a6-41eb-86e4-981ff5d06f7f req-040c8307-9bd4-437d-9419-00d62a43db0a tempest-VolumesSnapshotsTestJSON-594614211 None] Volume volume-954b0ea2-5d2a-49f1-b680-025426cbe526 (954b0ea2-5d2a-49f1-b680-025426cbe526): created successfully Apr 28 19:15:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-90157d53-03a6-41eb-86e4-981ff5d06f7f req-040c8307-9bd4-437d-9419-00d62a43db0a tempest-VolumesSnapshotsTestJSON-594614211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b45ae73-3f20-40ab-8aa6-6227827bf710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-90157d53-03a6-41eb-86e4-981ff5d06f7f req-040c8307-9bd4-437d-9419-00d62a43db0a tempest-VolumesSnapshotsTestJSON-594614211 None] Flow 'volume_create_manager' (8b043112-d8cc-4d01-b3ed-d26a3bf996e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:15:10 devstack cinder-volume[83863]: INFO cinder.volume.manager [req-90157d53-03a6-41eb-86e4-981ff5d06f7f req-040c8307-9bd4-437d-9419-00d62a43db0a tempest-VolumesSnapshotsTestJSON-594614211 None] Created volume successfully. Apr 28 19:15:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-3bb932f6-2432-47da-ab96-18c413d9320c req-bf64eca4-6e75-468e-bd0c-4c5d219e6727 tempest-VolumesSnapshotsTestJSON-594614211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:15:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-3bb932f6-2432-47da-ab96-18c413d9320c req-bf64eca4-6e75-468e-bd0c-4c5d219e6727 tempest-VolumesSnapshotsTestJSON-594614211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:15:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [req-3bb932f6-2432-47da-ab96-18c413d9320c req-bf64eca4-6e75-468e-bd0c-4c5d219e6727 tempest-VolumesSnapshotsTestJSON-594614211 None] Creating offline snapshot 63a31612-f58e-43a0-bb71-bb36d2fc75d5 of volume 954b0ea2-5d2a-49f1-b680-025426cbe526 {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 19:15:11 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d6757c-3184-4bc6-9946-6f961f5525fe]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:15:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-3bb932f6-2432-47da-ab96-18c413d9320c req-bf64eca4-6e75-468e-bd0c-4c5d219e6727 tempest-VolumesSnapshotsTestJSON-594614211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-954b0ea2-5d2a-49f1-b680-025426cbe526 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:11 devstack sudo[85827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-954b0ea2-5d2a-49f1-b680-025426cbe526 Apr 28 19:15:11 devstack sudo[85827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:12 devstack sudo[85827]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-3bb932f6-2432-47da-ab96-18c413d9320c req-bf64eca4-6e75-468e-bd0c-4c5d219e6727 tempest-VolumesSnapshotsTestJSON-594614211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-954b0ea2-5d2a-49f1-b680-025426cbe526" returned: 0 in 0.840s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-3bb932f6-2432-47da-ab96-18c413d9320c req-bf64eca4-6e75-468e-bd0c-4c5d219e6727 tempest-VolumesSnapshotsTestJSON-594614211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-954b0ea2-5d2a-49f1-b680-025426cbe526,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-954b0ea2-5d2a-49f1-b680-025426cbe526.63a31612-f58e-43a0-bb71-bb36d2fc75d5 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:12 devstack sudo[85833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-954b0ea2-5d2a-49f1-b680-025426cbe526,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-954b0ea2-5d2a-49f1-b680-025426cbe526.63a31612-f58e-43a0-bb71-bb36d2fc75d5 1G Apr 28 19:15:12 devstack sudo[85833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:13 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-0327830f-fe62-412f-bdc9-7127caa22569 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:15:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0327830f-fe62-412f-bdc9-7127caa22569 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] Flow 'volume_create_manager' (f14c327e-0dc4-4bc8-9e39-f32452ef76a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:15:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0327830f-fe62-412f-bdc9-7127caa22569 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac096ef4-7ad3-410e-a536-346a16ce2ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0327830f-fe62-412f-bdc9-7127caa22569 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac096ef4-7ad3-410e-a536-346a16ce2ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1947403480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3188f93e-d044-468a-8b0e-ca1acc8a0e44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19274c8b462c46b79b92e4ab8aa05270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:15:13Z,use_quota=True,user_id='4e8843cd5b3740628b103434c026601a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:13 devstack sudo[85833]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0327830f-fe62-412f-bdc9-7127caa22569 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a46b857f-afc1-4fd9-97dd-51051e38477d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0327830f-fe62-412f-bdc9-7127caa22569 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a46b857f-afc1-4fd9-97dd-51051e38477d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0327830f-fe62-412f-bdc9-7127caa22569 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6ab10fe-852f-4c48-a4c3-8e98f2247d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0327830f-fe62-412f-bdc9-7127caa22569 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6ab10fe-852f-4c48-a4c3-8e98f2247d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3188f93e-d044-468a-8b0e-ca1acc8a0e44', 'volume_name': 'volume-3188f93e-d044-468a-8b0e-ca1acc8a0e44', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0327830f-fe62-412f-bdc9-7127caa22569 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (405f338b-fc83-44bd-8740-11ce0e6c1f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0327830f-fe62-412f-bdc9-7127caa22569 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (405f338b-fc83-44bd-8740-11ce0e6c1f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0327830f-fe62-412f-bdc9-7127caa22569 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c32e75d9-56da-4eaa-a4db-350bd73bdca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:13 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-0327830f-fe62-412f-bdc9-7127caa22569 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] Volume 3188f93e-d044-468a-8b0e-ca1acc8a0e44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3188f93e-d044-468a-8b0e-ca1acc8a0e44', 'volume_size': 1} Apr 28 19:15:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0327830f-fe62-412f-bdc9-7127caa22569 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:15:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-3bb932f6-2432-47da-ab96-18c413d9320c req-bf64eca4-6e75-468e-bd0c-4c5d219e6727 tempest-VolumesSnapshotsTestJSON-594614211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-954b0ea2-5d2a-49f1-b680-025426cbe526,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-954b0ea2-5d2a-49f1-b680-025426cbe526.63a31612-f58e-43a0-bb71-bb36d2fc75d5 1G" returned: 0 in 1.127s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-3bb932f6-2432-47da-ab96-18c413d9320c req-bf64eca4-6e75-468e-bd0c-4c5d219e6727 tempest-VolumesSnapshotsTestJSON-594614211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-954b0ea2-5d2a-49f1-b680-025426cbe526 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-954b0ea2-5d2a-49f1-b680-025426cbe526.63a31612-f58e-43a0-bb71-bb36d2fc75d5 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:13 devstack sudo[85839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-954b0ea2-5d2a-49f1-b680-025426cbe526 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-954b0ea2-5d2a-49f1-b680-025426cbe526.63a31612-f58e-43a0-bb71-bb36d2fc75d5 Apr 28 19:15:13 devstack sudo[85839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:14 devstack sudo[85839]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-3bb932f6-2432-47da-ab96-18c413d9320c req-bf64eca4-6e75-468e-bd0c-4c5d219e6727 tempest-VolumesSnapshotsTestJSON-594614211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-954b0ea2-5d2a-49f1-b680-025426cbe526 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-954b0ea2-5d2a-49f1-b680-025426cbe526.63a31612-f58e-43a0-bb71-bb36d2fc75d5" returned: 0 in 0.898s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:14 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [req-3bb932f6-2432-47da-ab96-18c413d9320c req-bf64eca4-6e75-468e-bd0c-4c5d219e6727 tempest-VolumesSnapshotsTestJSON-594614211 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-954b0ea2-5d2a-49f1-b680-025426cbe526.63a31612-f58e-43a0-bb71-bb36d2fc75d5 is being set with open permissions: ugo+rw Apr 28 19:15:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-3bb932f6-2432-47da-ab96-18c413d9320c req-bf64eca4-6e75-468e-bd0c-4c5d219e6727 tempest-VolumesSnapshotsTestJSON-594614211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-954b0ea2-5d2a-49f1-b680-025426cbe526.63a31612-f58e-43a0-bb71-bb36d2fc75d5 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:14 devstack sudo[85844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-954b0ea2-5d2a-49f1-b680-025426cbe526.63a31612-f58e-43a0-bb71-bb36d2fc75d5 Apr 28 19:15:14 devstack sudo[85844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:15 devstack sudo[85844]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-3bb932f6-2432-47da-ab96-18c413d9320c req-bf64eca4-6e75-468e-bd0c-4c5d219e6727 tempest-VolumesSnapshotsTestJSON-594614211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-954b0ea2-5d2a-49f1-b680-025426cbe526.63a31612-f58e-43a0-bb71-bb36d2fc75d5" returned: 0 in 0.755s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-3bb932f6-2432-47da-ab96-18c413d9320c req-bf64eca4-6e75-468e-bd0c-4c5d219e6727 tempest-VolumesSnapshotsTestJSON-594614211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-954b0ea2-5d2a-49f1-b680-025426cbe526.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:15 devstack sudo[85852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-954b0ea2-5d2a-49f1-b680-025426cbe526.info Apr 28 19:15:15 devstack sudo[85852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:15 devstack sudo[85852]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-3bb932f6-2432-47da-ab96-18c413d9320c req-bf64eca4-6e75-468e-bd0c-4c5d219e6727 tempest-VolumesSnapshotsTestJSON-594614211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-954b0ea2-5d2a-49f1-b680-025426cbe526.info" returned: 0 in 0.775s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:15 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [req-3bb932f6-2432-47da-ab96-18c413d9320c req-bf64eca4-6e75-468e-bd0c-4c5d219e6727 tempest-VolumesSnapshotsTestJSON-594614211 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-954b0ea2-5d2a-49f1-b680-025426cbe526.info is being set with open permissions: ugo+rw Apr 28 19:15:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-3bb932f6-2432-47da-ab96-18c413d9320c req-bf64eca4-6e75-468e-bd0c-4c5d219e6727 tempest-VolumesSnapshotsTestJSON-594614211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-954b0ea2-5d2a-49f1-b680-025426cbe526.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:15 devstack sudo[85868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-954b0ea2-5d2a-49f1-b680-025426cbe526.info Apr 28 19:15:15 devstack sudo[85868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:16 devstack sudo[85868]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-3bb932f6-2432-47da-ab96-18c413d9320c req-bf64eca4-6e75-468e-bd0c-4c5d219e6727 tempest-VolumesSnapshotsTestJSON-594614211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-954b0ea2-5d2a-49f1-b680-025426cbe526.info" returned: 0 in 0.626s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-3bb932f6-2432-47da-ab96-18c413d9320c req-bf64eca4-6e75-468e-bd0c-4c5d219e6727 tempest-VolumesSnapshotsTestJSON-594614211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.140s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:15:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0327830f-fe62-412f-bdc9-7127caa22569 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.139s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:15:16 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0327830f-fe62-412f-bdc9-7127caa22569 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1947403480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3188f93e-d044-468a-8b0e-ca1acc8a0e44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19274c8b462c46b79b92e4ab8aa05270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:15:13Z,use_quota=True,user_id='4e8843cd5b3740628b103434c026601a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:15:16 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-0327830f-fe62-412f-bdc9-7127caa22569 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] Creating volume 3188f93e-d044-468a-8b0e-ca1acc8a0e44 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:15:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0327830f-fe62-412f-bdc9-7127caa22569 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:15:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0327830f-fe62-412f-bdc9-7127caa22569 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:15:16 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0327830f-fe62-412f-bdc9-7127caa22569 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:15:16 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0327830f-fe62-412f-bdc9-7127caa22569 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:15:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0327830f-fe62-412f-bdc9-7127caa22569 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:15:16 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0327830f-fe62-412f-bdc9-7127caa22569 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:15:16 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-0327830f-fe62-412f-bdc9-7127caa22569 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:15:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0327830f-fe62-412f-bdc9-7127caa22569 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3188f93e-d044-468a-8b0e-ca1acc8a0e44 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:16 devstack sudo[85871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3188f93e-d044-468a-8b0e-ca1acc8a0e44 1073741824 Apr 28 19:15:16 devstack sudo[85871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:16 devstack cinder-volume[83863]: INFO cinder.volume.manager [req-3bb932f6-2432-47da-ab96-18c413d9320c req-bf64eca4-6e75-468e-bd0c-4c5d219e6727 tempest-VolumesSnapshotsTestJSON-594614211 None] Create snapshot completed successfully Apr 28 19:15:17 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-c0fe2ecc-3f7a-49f3-bd92-487929a16931 tempest-GroupSnapshotsV319Test-2073677593 None] Group tempest-GroupSnapshotsV319Test-Group-181892767: creating Apr 28 19:15:17 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-c0fe2ecc-3f7a-49f3-bd92-487929a16931 tempest-GroupSnapshotsV319Test-2073677593 None] Group tempest-GroupSnapshotsV319Test-Group-181892767: created successfully Apr 28 19:15:17 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-c0fe2ecc-3f7a-49f3-bd92-487929a16931 tempest-GroupSnapshotsV319Test-2073677593 None] Create group completed successfully. Apr 28 19:15:17 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-4e6f1c95-b3e9-4560-80d8-96ca96192119 req-2cba3310-b939-45ee-81cf-e2b833c716b6 tempest-VolumesSnapshotsTestJSON-594614211 None] Acquiring lock "cinder-63a31612-f58e-43a0-bb71-bb36d2fc75d5-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:15:17 devstack sudo[85871]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0327830f-fe62-412f-bdc9-7127caa22569 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3188f93e-d044-468a-8b0e-ca1acc8a0e44 1073741824" returned: 0 in 0.860s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:17 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-4e6f1c95-b3e9-4560-80d8-96ca96192119 req-2cba3310-b939-45ee-81cf-e2b833c716b6 tempest-VolumesSnapshotsTestJSON-594614211 None] Lock "cinder-63a31612-f58e-43a0-bb71-bb36d2fc75d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:15:17 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-4e6f1c95-b3e9-4560-80d8-96ca96192119 req-2cba3310-b939-45ee-81cf-e2b833c716b6 tempest-VolumesSnapshotsTestJSON-594614211 None] Acquiring lock "cinder-quobyte-954b0ea2-5d2a-49f1-b680-025426cbe526" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:15:17 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-4e6f1c95-b3e9-4560-80d8-96ca96192119 req-2cba3310-b939-45ee-81cf-e2b833c716b6 tempest-VolumesSnapshotsTestJSON-594614211 None] Lock "cinder-quobyte-954b0ea2-5d2a-49f1-b680-025426cbe526" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:15:17 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-4e6f1c95-b3e9-4560-80d8-96ca96192119 req-2cba3310-b939-45ee-81cf-e2b833c716b6 tempest-VolumesSnapshotsTestJSON-594614211 None] Acquiring lock "cinder-quobyte-63a31612-f58e-43a0-bb71-bb36d2fc75d5" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:15:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0327830f-fe62-412f-bdc9-7127caa22569 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3188f93e-d044-468a-8b0e-ca1acc8a0e44 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:17 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-4e6f1c95-b3e9-4560-80d8-96ca96192119 req-2cba3310-b939-45ee-81cf-e2b833c716b6 tempest-VolumesSnapshotsTestJSON-594614211 None] Lock "cinder-quobyte-63a31612-f58e-43a0-bb71-bb36d2fc75d5" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:15:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [req-4e6f1c95-b3e9-4560-80d8-96ca96192119 req-2cba3310-b939-45ee-81cf-e2b833c716b6 tempest-VolumesSnapshotsTestJSON-594614211 None] Deleting offline snapshot 63a31612-f58e-43a0-bb71-bb36d2fc75d5 of volume 954b0ea2-5d2a-49f1-b680-025426cbe526 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 19:15:17 devstack sudo[85878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3188f93e-d044-468a-8b0e-ca1acc8a0e44 Apr 28 19:15:17 devstack sudo[85878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [req-4e6f1c95-b3e9-4560-80d8-96ca96192119 req-2cba3310-b939-45ee-81cf-e2b833c716b6 tempest-VolumesSnapshotsTestJSON-594614211 None] snapshot_file for this snap is: volume-954b0ea2-5d2a-49f1-b680-025426cbe526.63a31612-f58e-43a0-bb71-bb36d2fc75d5 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 19:15:17 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[acda0d48-909a-4ac3-8ea9-33f51c9db22f]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:15:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-4e6f1c95-b3e9-4560-80d8-96ca96192119 req-2cba3310-b939-45ee-81cf-e2b833c716b6 tempest-VolumesSnapshotsTestJSON-594614211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-954b0ea2-5d2a-49f1-b680-025426cbe526.63a31612-f58e-43a0-bb71-bb36d2fc75d5 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:17 devstack sudo[85880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-954b0ea2-5d2a-49f1-b680-025426cbe526.63a31612-f58e-43a0-bb71-bb36d2fc75d5 Apr 28 19:15:17 devstack sudo[85880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:18 devstack sudo[85878]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0327830f-fe62-412f-bdc9-7127caa22569 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3188f93e-d044-468a-8b0e-ca1acc8a0e44" returned: 0 in 0.613s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:18 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0327830f-fe62-412f-bdc9-7127caa22569 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] <== create_volume: return (1529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:15:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0327830f-fe62-412f-bdc9-7127caa22569 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.532s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:15:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0327830f-fe62-412f-bdc9-7127caa22569 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c32e75d9-56da-4eaa-a4db-350bd73bdca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3188f93e-d044-468a-8b0e-ca1acc8a0e44', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0327830f-fe62-412f-bdc9-7127caa22569 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d64cc3f5-4be4-4f01-9825-037a9d459912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:18 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-0327830f-fe62-412f-bdc9-7127caa22569 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] Volume volume-3188f93e-d044-468a-8b0e-ca1acc8a0e44 (3188f93e-d044-468a-8b0e-ca1acc8a0e44): created successfully Apr 28 19:15:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0327830f-fe62-412f-bdc9-7127caa22569 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d64cc3f5-4be4-4f01-9825-037a9d459912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0327830f-fe62-412f-bdc9-7127caa22569 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] Flow 'volume_create_manager' (f14c327e-0dc4-4bc8-9e39-f32452ef76a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:15:18 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-0327830f-fe62-412f-bdc9-7127caa22569 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] Created volume successfully. Apr 28 19:15:18 devstack sudo[85880]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-4e6f1c95-b3e9-4560-80d8-96ca96192119 req-2cba3310-b939-45ee-81cf-e2b833c716b6 tempest-VolumesSnapshotsTestJSON-594614211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-954b0ea2-5d2a-49f1-b680-025426cbe526.63a31612-f58e-43a0-bb71-bb36d2fc75d5" returned: 0 in 0.789s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:18 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [req-4e6f1c95-b3e9-4560-80d8-96ca96192119 req-2cba3310-b939-45ee-81cf-e2b833c716b6 tempest-VolumesSnapshotsTestJSON-594614211 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-954b0ea2-5d2a-49f1-b680-025426cbe526(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:15:18 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[623736d5-fd7e-4e97-bb02-0f3076455146]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:15:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-4e6f1c95-b3e9-4560-80d8-96ca96192119 req-2cba3310-b939-45ee-81cf-e2b833c716b6 tempest-VolumesSnapshotsTestJSON-594614211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-954b0ea2-5d2a-49f1-b680-025426cbe526 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:18 devstack sudo[85887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-954b0ea2-5d2a-49f1-b680-025426cbe526 Apr 28 19:15:18 devstack sudo[85887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:18 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-da248c4a-9e42-48a4-967a-6bbd9755bd1e tempest-GroupSnapshotsV319Test-2073677593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:15:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-da248c4a-9e42-48a4-967a-6bbd9755bd1e tempest-GroupSnapshotsV319Test-2073677593 None] Flow 'volume_create_manager' (4841c635-3060-49a2-9ce7-2ba86a91466e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:15:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-da248c4a-9e42-48a4-967a-6bbd9755bd1e tempest-GroupSnapshotsV319Test-2073677593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdda8b26-7dcc-4589-8871-beab4ed8c696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-da248c4a-9e42-48a4-967a-6bbd9755bd1e tempest-GroupSnapshotsV319Test-2073677593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdda8b26-7dcc-4589-8871-beab4ed8c696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1008134051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=22ad970b-7ca2-4f49-95e6-2da331d17463,host='devstack@QuobyteHD#QuobyteHD',id=6d374efd-3049-44d5-bf8c-29f301e91d89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73af84ef44c44180aad36389b38cb1c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:15:19Z,use_quota=True,user_id='1f11b6e6945841dcbfb3538a836c347a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(caeff6ff-c796-48b6-acd6-5f1ff2039b68),volume_type_id=caeff6ff-c796-48b6-acd6-5f1ff2039b68)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-da248c4a-9e42-48a4-967a-6bbd9755bd1e tempest-GroupSnapshotsV319Test-2073677593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c21a0ad9-4e70-48a8-ad8e-aeddb64eea5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-da248c4a-9e42-48a4-967a-6bbd9755bd1e tempest-GroupSnapshotsV319Test-2073677593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c21a0ad9-4e70-48a8-ad8e-aeddb64eea5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-da248c4a-9e42-48a4-967a-6bbd9755bd1e tempest-GroupSnapshotsV319Test-2073677593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d0fef15-8f3c-4de1-a839-7cd3aa2e98e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-da248c4a-9e42-48a4-967a-6bbd9755bd1e tempest-GroupSnapshotsV319Test-2073677593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d0fef15-8f3c-4de1-a839-7cd3aa2e98e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d374efd-3049-44d5-bf8c-29f301e91d89', 'volume_name': 'volume-6d374efd-3049-44d5-bf8c-29f301e91d89', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-da248c4a-9e42-48a4-967a-6bbd9755bd1e tempest-GroupSnapshotsV319Test-2073677593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bd6ceff-0be0-45b3-9b3e-3dac52e968e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-da248c4a-9e42-48a4-967a-6bbd9755bd1e tempest-GroupSnapshotsV319Test-2073677593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bd6ceff-0be0-45b3-9b3e-3dac52e968e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-da248c4a-9e42-48a4-967a-6bbd9755bd1e tempest-GroupSnapshotsV319Test-2073677593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd254dc1-1fab-44fa-ac8a-425c6d42fb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:18 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-da248c4a-9e42-48a4-967a-6bbd9755bd1e tempest-GroupSnapshotsV319Test-2073677593 None] Volume 6d374efd-3049-44d5-bf8c-29f301e91d89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d374efd-3049-44d5-bf8c-29f301e91d89', 'volume_size': 1} Apr 28 19:15:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-da248c4a-9e42-48a4-967a-6bbd9755bd1e tempest-GroupSnapshotsV319Test-2073677593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:15:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-da248c4a-9e42-48a4-967a-6bbd9755bd1e tempest-GroupSnapshotsV319Test-2073677593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:15:18 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-da248c4a-9e42-48a4-967a-6bbd9755bd1e tempest-GroupSnapshotsV319Test-2073677593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=22ad970b-7ca2-4f49-95e6-2da331d17463,created_at=2026-04-28T17:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1008134051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=22ad970b-7ca2-4f49-95e6-2da331d17463,host='devstack@QuobyteHD#QuobyteHD',id=6d374efd-3049-44d5-bf8c-29f301e91d89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73af84ef44c44180aad36389b38cb1c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:15:19Z,use_quota=True,user_id='1f11b6e6945841dcbfb3538a836c347a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(caeff6ff-c796-48b6-acd6-5f1ff2039b68),volume_type_id=caeff6ff-c796-48b6-acd6-5f1ff2039b68)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:15:18 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-da248c4a-9e42-48a4-967a-6bbd9755bd1e tempest-GroupSnapshotsV319Test-2073677593 None] Creating volume 6d374efd-3049-44d5-bf8c-29f301e91d89 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:15:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-da248c4a-9e42-48a4-967a-6bbd9755bd1e tempest-GroupSnapshotsV319Test-2073677593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:15:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-da248c4a-9e42-48a4-967a-6bbd9755bd1e tempest-GroupSnapshotsV319Test-2073677593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:15:18 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-da248c4a-9e42-48a4-967a-6bbd9755bd1e tempest-GroupSnapshotsV319Test-2073677593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:15:18 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-da248c4a-9e42-48a4-967a-6bbd9755bd1e tempest-GroupSnapshotsV319Test-2073677593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:15:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-da248c4a-9e42-48a4-967a-6bbd9755bd1e tempest-GroupSnapshotsV319Test-2073677593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:15:18 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-da248c4a-9e42-48a4-967a-6bbd9755bd1e tempest-GroupSnapshotsV319Test-2073677593 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:15:18 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-da248c4a-9e42-48a4-967a-6bbd9755bd1e tempest-GroupSnapshotsV319Test-2073677593 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:15:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-da248c4a-9e42-48a4-967a-6bbd9755bd1e tempest-GroupSnapshotsV319Test-2073677593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6d374efd-3049-44d5-bf8c-29f301e91d89 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:18 devstack sudo[85893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6d374efd-3049-44d5-bf8c-29f301e91d89 1073741824 Apr 28 19:15:18 devstack sudo[85893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:19 devstack sudo[85887]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-4e6f1c95-b3e9-4560-80d8-96ca96192119 req-2cba3310-b939-45ee-81cf-e2b833c716b6 tempest-VolumesSnapshotsTestJSON-594614211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-954b0ea2-5d2a-49f1-b680-025426cbe526" returned: 0 in 0.831s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-4e6f1c95-b3e9-4560-80d8-96ca96192119 req-2cba3310-b939-45ee-81cf-e2b833c716b6 tempest-VolumesSnapshotsTestJSON-594614211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-954b0ea2-5d2a-49f1-b680-025426cbe526.63a31612-f58e-43a0-bb71-bb36d2fc75d5 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:19 devstack sudo[85898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-954b0ea2-5d2a-49f1-b680-025426cbe526.63a31612-f58e-43a0-bb71-bb36d2fc75d5 Apr 28 19:15:19 devstack sudo[85898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:19 devstack sudo[85893]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-da248c4a-9e42-48a4-967a-6bbd9755bd1e tempest-GroupSnapshotsV319Test-2073677593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6d374efd-3049-44d5-bf8c-29f301e91d89 1073741824" returned: 0 in 0.925s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:19 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cac0eaf6-3c6e-45e3-975c-90926b372045 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] Acquiring lock "cinder-3188f93e-d044-468a-8b0e-ca1acc8a0e44-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:15:19 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cac0eaf6-3c6e-45e3-975c-90926b372045 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] Lock "cinder-3188f93e-d044-468a-8b0e-ca1acc8a0e44-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:15:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-da248c4a-9e42-48a4-967a-6bbd9755bd1e tempest-GroupSnapshotsV319Test-2073677593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6d374efd-3049-44d5-bf8c-29f301e91d89 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:19 devstack sudo[85909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6d374efd-3049-44d5-bf8c-29f301e91d89 Apr 28 19:15:19 devstack sudo[85909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:19 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cac0eaf6-3c6e-45e3-975c-90926b372045 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] Acquiring lock "cinder-quobyte-3188f93e-d044-468a-8b0e-ca1acc8a0e44" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:15:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cac0eaf6-3c6e-45e3-975c-90926b372045 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] Lock "cinder-quobyte-3188f93e-d044-468a-8b0e-ca1acc8a0e44" acquired by "delete_volume" :: waited 0.017s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:15:20 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86b26de-7d22-4f81-9bd6-be66589c67c5]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:15:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cac0eaf6-3c6e-45e3-975c-90926b372045 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3188f93e-d044-468a-8b0e-ca1acc8a0e44 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:20 devstack sudo[85898]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-4e6f1c95-b3e9-4560-80d8-96ca96192119 req-2cba3310-b939-45ee-81cf-e2b833c716b6 tempest-VolumesSnapshotsTestJSON-594614211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-954b0ea2-5d2a-49f1-b680-025426cbe526.63a31612-f58e-43a0-bb71-bb36d2fc75d5" returned: 0 in 0.840s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-4e6f1c95-b3e9-4560-80d8-96ca96192119 req-2cba3310-b939-45ee-81cf-e2b833c716b6 tempest-VolumesSnapshotsTestJSON-594614211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-954b0ea2-5d2a-49f1-b680-025426cbe526.63a31612-f58e-43a0-bb71-bb36d2fc75d5 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:20 devstack sudo[85912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-954b0ea2-5d2a-49f1-b680-025426cbe526.63a31612-f58e-43a0-bb71-bb36d2fc75d5 Apr 28 19:15:20 devstack sudo[85912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:20 devstack sudo[85911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3188f93e-d044-468a-8b0e-ca1acc8a0e44 Apr 28 19:15:20 devstack sudo[85911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:21 devstack sudo[85909]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-da248c4a-9e42-48a4-967a-6bbd9755bd1e tempest-GroupSnapshotsV319Test-2073677593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6d374efd-3049-44d5-bf8c-29f301e91d89" returned: 0 in 1.117s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:21 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-da248c4a-9e42-48a4-967a-6bbd9755bd1e tempest-GroupSnapshotsV319Test-2073677593 None] <== create_volume: return (2121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:15:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-da248c4a-9e42-48a4-967a-6bbd9755bd1e tempest-GroupSnapshotsV319Test-2073677593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.124s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:15:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-da248c4a-9e42-48a4-967a-6bbd9755bd1e tempest-GroupSnapshotsV319Test-2073677593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd254dc1-1fab-44fa-ac8a-425c6d42fb12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d374efd-3049-44d5-bf8c-29f301e91d89', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-da248c4a-9e42-48a4-967a-6bbd9755bd1e tempest-GroupSnapshotsV319Test-2073677593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7057db15-a6e5-4be5-975c-5a3795d26dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:21 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-da248c4a-9e42-48a4-967a-6bbd9755bd1e tempest-GroupSnapshotsV319Test-2073677593 None] Volume volume-6d374efd-3049-44d5-bf8c-29f301e91d89 (6d374efd-3049-44d5-bf8c-29f301e91d89): created successfully Apr 28 19:15:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-da248c4a-9e42-48a4-967a-6bbd9755bd1e tempest-GroupSnapshotsV319Test-2073677593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7057db15-a6e5-4be5-975c-5a3795d26dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-da248c4a-9e42-48a4-967a-6bbd9755bd1e tempest-GroupSnapshotsV319Test-2073677593 None] Flow 'volume_create_manager' (4841c635-3060-49a2-9ce7-2ba86a91466e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:15:21 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-da248c4a-9e42-48a4-967a-6bbd9755bd1e tempest-GroupSnapshotsV319Test-2073677593 None] Created volume successfully. Apr 28 19:15:21 devstack sudo[85911]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cac0eaf6-3c6e-45e3-975c-90926b372045 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3188f93e-d044-468a-8b0e-ca1acc8a0e44" returned: 0 in 1.447s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cac0eaf6-3c6e-45e3-975c-90926b372045 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3188f93e-d044-468a-8b0e-ca1acc8a0e44 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:21 devstack sudo[85912]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-4e6f1c95-b3e9-4560-80d8-96ca96192119 req-2cba3310-b939-45ee-81cf-e2b833c716b6 tempest-VolumesSnapshotsTestJSON-594614211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-954b0ea2-5d2a-49f1-b680-025426cbe526.63a31612-f58e-43a0-bb71-bb36d2fc75d5" returned: 0 in 1.425s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:21 devstack sudo[85984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3188f93e-d044-468a-8b0e-ca1acc8a0e44 Apr 28 19:15:21 devstack sudo[85984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:21 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-4e6f1c95-b3e9-4560-80d8-96ca96192119 req-2cba3310-b939-45ee-81cf-e2b833c716b6 tempest-VolumesSnapshotsTestJSON-594614211 None] Lock "cinder-quobyte-63a31612-f58e-43a0-bb71-bb36d2fc75d5" released by "_delete_snapshot" :: held 4.017s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:15:21 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-4e6f1c95-b3e9-4560-80d8-96ca96192119 req-2cba3310-b939-45ee-81cf-e2b833c716b6 tempest-VolumesSnapshotsTestJSON-594614211 None] Lock "cinder-quobyte-954b0ea2-5d2a-49f1-b680-025426cbe526" released by "delete_snapshot" :: held 4.055s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:15:21 devstack cinder-volume[83863]: WARNING cinder.quota [req-4e6f1c95-b3e9-4560-80d8-96ca96192119 req-2cba3310-b939-45ee-81cf-e2b833c716b6 tempest-VolumesSnapshotsTestJSON-594614211 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 28 19:15:21 devstack cinder-volume[83863]: DEBUG cinder.quota [req-4e6f1c95-b3e9-4560-80d8-96ca96192119 req-2cba3310-b939-45ee-81cf-e2b833c716b6 tempest-VolumesSnapshotsTestJSON-594614211 None] Created reservations ['9d511cc7-2624-4cdb-b8b3-7a92efb7bb68', '6a3f59e1-076b-4bb6-be25-5e5ad3129763', '11454fcd-f1cd-4a2e-9e4f-4006da0d4428', '6d60c7b6-2399-452c-9fc6-ef60f670a64c'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:15:21 devstack cinder-volume[83863]: INFO cinder.volume.manager [req-4e6f1c95-b3e9-4560-80d8-96ca96192119 req-2cba3310-b939-45ee-81cf-e2b833c716b6 tempest-VolumesSnapshotsTestJSON-594614211 None] Delete snapshot completed successfully. Apr 28 19:15:21 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-4e6f1c95-b3e9-4560-80d8-96ca96192119 req-2cba3310-b939-45ee-81cf-e2b833c716b6 tempest-VolumesSnapshotsTestJSON-594614211 None] Lock "cinder-63a31612-f58e-43a0-bb71-bb36d2fc75d5-delete_snapshot" released by "delete_snapshot" :: held 4.221s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:15:21 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-a39ff446-b1e1-4768-9ea6-09a9094431a4 req-c60b015c-151a-4b46-a086-defce5cc6142 tempest-VolumesSnapshotsTestJSON-594614211 None] Acquiring lock "cinder-954b0ea2-5d2a-49f1-b680-025426cbe526-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:15:21 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-a39ff446-b1e1-4768-9ea6-09a9094431a4 req-c60b015c-151a-4b46-a086-defce5cc6142 tempest-VolumesSnapshotsTestJSON-594614211 None] Lock "cinder-954b0ea2-5d2a-49f1-b680-025426cbe526-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:15:22 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-a39ff446-b1e1-4768-9ea6-09a9094431a4 req-c60b015c-151a-4b46-a086-defce5cc6142 tempest-VolumesSnapshotsTestJSON-594614211 None] Acquiring lock "cinder-quobyte-954b0ea2-5d2a-49f1-b680-025426cbe526" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:15:22 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-a39ff446-b1e1-4768-9ea6-09a9094431a4 req-c60b015c-151a-4b46-a086-defce5cc6142 tempest-VolumesSnapshotsTestJSON-594614211 None] Lock "cinder-quobyte-954b0ea2-5d2a-49f1-b680-025426cbe526" acquired by "delete_volume" :: waited 0.025s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:15:22 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5c7614-482d-4e54-a43d-9a58139c69e8]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:15:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-a39ff446-b1e1-4768-9ea6-09a9094431a4 req-c60b015c-151a-4b46-a086-defce5cc6142 tempest-VolumesSnapshotsTestJSON-594614211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-954b0ea2-5d2a-49f1-b680-025426cbe526 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:22 devstack sudo[85984]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cac0eaf6-3c6e-45e3-975c-90926b372045 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3188f93e-d044-468a-8b0e-ca1acc8a0e44" returned: 0 in 0.692s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:22 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cac0eaf6-3c6e-45e3-975c-90926b372045 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] Lock "cinder-quobyte-3188f93e-d044-468a-8b0e-ca1acc8a0e44" released by "delete_volume" :: held 2.209s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:15:22 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-cac0eaf6-3c6e-45e3-975c-90926b372045 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] Created reservations ['b7f9859f-c16e-4a13-8083-777f05b7f121', '818afa13-7b2f-4288-9538-f8b920152381', 'fc152d28-049c-4d16-a1d5-308a0728cdde', 'af77c85e-756d-4c2e-ab0c-0beedc1a90b6'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:15:22 devstack sudo[85989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-954b0ea2-5d2a-49f1-b680-025426cbe526 Apr 28 19:15:22 devstack sudo[85989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-cac0eaf6-3c6e-45e3-975c-90926b372045 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:15:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-cac0eaf6-3c6e-45e3-975c-90926b372045 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:15:22 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-cac0eaf6-3c6e-45e3-975c-90926b372045 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:15:22 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-cac0eaf6-3c6e-45e3-975c-90926b372045 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:15:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-cac0eaf6-3c6e-45e3-975c-90926b372045 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:15:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cac0eaf6-3c6e-45e3-975c-90926b372045 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:22 devstack sudo[85991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:15:22 devstack sudo[85991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:22 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-3e763206-d8c9-475a-8ade-f86297b3b72b tempest-GroupSnapshotsV319Test-2073677593 None] GroupSnapshot 39d84351-723e-428f-b7e4-650dca1cd0fc: creating. Apr 28 19:15:23 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3e763206-d8c9-475a-8ade-f86297b3b72b tempest-GroupSnapshotsV319Test-2073677593 None] Group snapshot 39d84351-723e-428f-b7e4-650dca1cd0fc: creating. {{(pid=83863) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 28 19:15:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3e763206-d8c9-475a-8ade-f86297b3b72b tempest-GroupSnapshotsV319Test-2073677593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:15:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3e763206-d8c9-475a-8ade-f86297b3b72b tempest-GroupSnapshotsV319Test-2073677593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:15:23 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-3e763206-d8c9-475a-8ade-f86297b3b72b tempest-GroupSnapshotsV319Test-2073677593 None] Creating offline snapshot b681ef54-5369-4dfc-8130-70e9cfe3826d of volume 6d374efd-3049-44d5-bf8c-29f301e91d89 {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 19:15:23 devstack sudo[85989]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-a39ff446-b1e1-4768-9ea6-09a9094431a4 req-c60b015c-151a-4b46-a086-defce5cc6142 tempest-VolumesSnapshotsTestJSON-594614211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-954b0ea2-5d2a-49f1-b680-025426cbe526" returned: 0 in 0.959s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-a39ff446-b1e1-4768-9ea6-09a9094431a4 req-c60b015c-151a-4b46-a086-defce5cc6142 tempest-VolumesSnapshotsTestJSON-594614211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-954b0ea2-5d2a-49f1-b680-025426cbe526 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:23 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a1f477-ec7c-4e5d-aef8-d84ee9ae9e23]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:15:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e763206-d8c9-475a-8ade-f86297b3b72b tempest-GroupSnapshotsV319Test-2073677593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6d374efd-3049-44d5-bf8c-29f301e91d89 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:23 devstack sudo[85997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-954b0ea2-5d2a-49f1-b680-025426cbe526 Apr 28 19:15:23 devstack sudo[85997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:23 devstack sudo[85998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6d374efd-3049-44d5-bf8c-29f301e91d89 Apr 28 19:15:23 devstack sudo[85998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:23 devstack sudo[85991]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cac0eaf6-3c6e-45e3-975c-90926b372045 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.928s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:23 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-cac0eaf6-3c6e-45e3-975c-90926b372045 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:15:23 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-cac0eaf6-3c6e-45e3-975c-90926b372045 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] Deleted volume successfully. Apr 28 19:15:23 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cac0eaf6-3c6e-45e3-975c-90926b372045 tempest-VolumeQuotasNegativeTestJSON-2032511711 None] Lock "cinder-3188f93e-d044-468a-8b0e-ca1acc8a0e44-delete_volume" released by "delete_volume" :: held 3.514s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:15:24 devstack sudo[85997]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-a39ff446-b1e1-4768-9ea6-09a9094431a4 req-c60b015c-151a-4b46-a086-defce5cc6142 tempest-VolumesSnapshotsTestJSON-594614211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-954b0ea2-5d2a-49f1-b680-025426cbe526" returned: 0 in 1.086s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:24 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-a39ff446-b1e1-4768-9ea6-09a9094431a4 req-c60b015c-151a-4b46-a086-defce5cc6142 tempest-VolumesSnapshotsTestJSON-594614211 None] Lock "cinder-quobyte-954b0ea2-5d2a-49f1-b680-025426cbe526" released by "delete_volume" :: held 2.182s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:15:24 devstack cinder-volume[83863]: DEBUG cinder.quota [req-a39ff446-b1e1-4768-9ea6-09a9094431a4 req-c60b015c-151a-4b46-a086-defce5cc6142 tempest-VolumesSnapshotsTestJSON-594614211 None] Created reservations ['44200f91-04b6-4ab2-96be-f30ce3392661', 'fda68a41-9252-4f19-94d7-ad32fc485eb9', '2645dcde-4069-4ebd-8490-c7db0b6d72ac', '0f2bd2a5-e57e-44e1-aebe-5df096e82f7c'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:15:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-a39ff446-b1e1-4768-9ea6-09a9094431a4 req-c60b015c-151a-4b46-a086-defce5cc6142 tempest-VolumesSnapshotsTestJSON-594614211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:15:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-a39ff446-b1e1-4768-9ea6-09a9094431a4 req-c60b015c-151a-4b46-a086-defce5cc6142 tempest-VolumesSnapshotsTestJSON-594614211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:15:24 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-a39ff446-b1e1-4768-9ea6-09a9094431a4 req-c60b015c-151a-4b46-a086-defce5cc6142 tempest-VolumesSnapshotsTestJSON-594614211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:15:24 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-a39ff446-b1e1-4768-9ea6-09a9094431a4 req-c60b015c-151a-4b46-a086-defce5cc6142 tempest-VolumesSnapshotsTestJSON-594614211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:15:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-a39ff446-b1e1-4768-9ea6-09a9094431a4 req-c60b015c-151a-4b46-a086-defce5cc6142 tempest-VolumesSnapshotsTestJSON-594614211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:15:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-a39ff446-b1e1-4768-9ea6-09a9094431a4 req-c60b015c-151a-4b46-a086-defce5cc6142 tempest-VolumesSnapshotsTestJSON-594614211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:24 devstack sudo[85998]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e763206-d8c9-475a-8ade-f86297b3b72b tempest-GroupSnapshotsV319Test-2073677593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6d374efd-3049-44d5-bf8c-29f301e91d89" returned: 0 in 1.395s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:24 devstack sudo[86006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:15:24 devstack sudo[86006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e763206-d8c9-475a-8ade-f86297b3b72b tempest-GroupSnapshotsV319Test-2073677593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6d374efd-3049-44d5-bf8c-29f301e91d89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6d374efd-3049-44d5-bf8c-29f301e91d89.b681ef54-5369-4dfc-8130-70e9cfe3826d 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:24 devstack sudo[86008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6d374efd-3049-44d5-bf8c-29f301e91d89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6d374efd-3049-44d5-bf8c-29f301e91d89.b681ef54-5369-4dfc-8130-70e9cfe3826d 1G Apr 28 19:15:24 devstack sudo[86008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:24 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa955f8f-5c4f-46da-aee9-a2f7e0c64923 tempest-DeleteServersTestJSON-1034568749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:15:24 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fa955f8f-5c4f-46da-aee9-a2f7e0c64923 tempest-DeleteServersTestJSON-1034568749 None] Flow 'volume_create_manager' (167c4716-2007-465a-803a-82fbaef82e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:15:24 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fa955f8f-5c4f-46da-aee9-a2f7e0c64923 tempest-DeleteServersTestJSON-1034568749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (000150da-886d-451e-adb3-b4d495354907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:24 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fa955f8f-5c4f-46da-aee9-a2f7e0c64923 tempest-DeleteServersTestJSON-1034568749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (000150da-886d-451e-adb3-b4d495354907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1846009302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e50ff44-c79c-43b1-955d-fc92f513c0f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea9ab8b1f1cc412199903c5aa482d4df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:15:25Z,use_quota=True,user_id='f1680a4a29ba4a7d92fe16c59c916bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:24 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fa955f8f-5c4f-46da-aee9-a2f7e0c64923 tempest-DeleteServersTestJSON-1034568749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b47ba97c-a75f-4522-a3d4-26c0622f2d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fa955f8f-5c4f-46da-aee9-a2f7e0c64923 tempest-DeleteServersTestJSON-1034568749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b47ba97c-a75f-4522-a3d4-26c0622f2d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fa955f8f-5c4f-46da-aee9-a2f7e0c64923 tempest-DeleteServersTestJSON-1034568749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6071f91a-a1c0-432d-83e4-d76cb51ec78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fa955f8f-5c4f-46da-aee9-a2f7e0c64923 tempest-DeleteServersTestJSON-1034568749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6071f91a-a1c0-432d-83e4-d76cb51ec78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e50ff44-c79c-43b1-955d-fc92f513c0f5', 'volume_name': 'volume-5e50ff44-c79c-43b1-955d-fc92f513c0f5', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fa955f8f-5c4f-46da-aee9-a2f7e0c64923 tempest-DeleteServersTestJSON-1034568749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea2ef18e-07dc-4205-bf98-974b4d7bea49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fa955f8f-5c4f-46da-aee9-a2f7e0c64923 tempest-DeleteServersTestJSON-1034568749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea2ef18e-07dc-4205-bf98-974b4d7bea49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fa955f8f-5c4f-46da-aee9-a2f7e0c64923 tempest-DeleteServersTestJSON-1034568749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d055843-d92d-4812-9a0d-fb582e0e088d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:25 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-fa955f8f-5c4f-46da-aee9-a2f7e0c64923 tempest-DeleteServersTestJSON-1034568749 None] Volume 5e50ff44-c79c-43b1-955d-fc92f513c0f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e50ff44-c79c-43b1-955d-fc92f513c0f5', 'volume_size': 1} Apr 28 19:15:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fa955f8f-5c4f-46da-aee9-a2f7e0c64923 tempest-DeleteServersTestJSON-1034568749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:15:25 devstack sudo[86006]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-a39ff446-b1e1-4768-9ea6-09a9094431a4 req-c60b015c-151a-4b46-a086-defce5cc6142 tempest-VolumesSnapshotsTestJSON-594614211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.975s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:25 devstack cinder-volume[83863]: DEBUG cinder.manager [req-a39ff446-b1e1-4768-9ea6-09a9094431a4 req-c60b015c-151a-4b46-a086-defce5cc6142 tempest-VolumesSnapshotsTestJSON-594614211 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:15:25 devstack cinder-volume[83863]: INFO cinder.volume.manager [req-a39ff446-b1e1-4768-9ea6-09a9094431a4 req-c60b015c-151a-4b46-a086-defce5cc6142 tempest-VolumesSnapshotsTestJSON-594614211 None] Deleted volume successfully. Apr 28 19:15:25 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-a39ff446-b1e1-4768-9ea6-09a9094431a4 req-c60b015c-151a-4b46-a086-defce5cc6142 tempest-VolumesSnapshotsTestJSON-594614211 None] Lock "cinder-954b0ea2-5d2a-49f1-b680-025426cbe526-delete_volume" released by "delete_volume" :: held 3.523s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:15:25 devstack sudo[86008]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e763206-d8c9-475a-8ade-f86297b3b72b tempest-GroupSnapshotsV319Test-2073677593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6d374efd-3049-44d5-bf8c-29f301e91d89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6d374efd-3049-44d5-bf8c-29f301e91d89.b681ef54-5369-4dfc-8130-70e9cfe3826d 1G" returned: 0 in 1.338s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e763206-d8c9-475a-8ade-f86297b3b72b tempest-GroupSnapshotsV319Test-2073677593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d374efd-3049-44d5-bf8c-29f301e91d89 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6d374efd-3049-44d5-bf8c-29f301e91d89.b681ef54-5369-4dfc-8130-70e9cfe3826d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:25 devstack sudo[86016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d374efd-3049-44d5-bf8c-29f301e91d89 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6d374efd-3049-44d5-bf8c-29f301e91d89.b681ef54-5369-4dfc-8130-70e9cfe3826d Apr 28 19:15:25 devstack sudo[86016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:26 devstack sudo[86016]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e763206-d8c9-475a-8ade-f86297b3b72b tempest-GroupSnapshotsV319Test-2073677593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d374efd-3049-44d5-bf8c-29f301e91d89 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6d374efd-3049-44d5-bf8c-29f301e91d89.b681ef54-5369-4dfc-8130-70e9cfe3826d" returned: 0 in 0.878s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:26 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-3e763206-d8c9-475a-8ade-f86297b3b72b tempest-GroupSnapshotsV319Test-2073677593 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6d374efd-3049-44d5-bf8c-29f301e91d89.b681ef54-5369-4dfc-8130-70e9cfe3826d is being set with open permissions: ugo+rw: NotImplementedError Apr 28 19:15:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e763206-d8c9-475a-8ade-f86297b3b72b tempest-GroupSnapshotsV319Test-2073677593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6d374efd-3049-44d5-bf8c-29f301e91d89.b681ef54-5369-4dfc-8130-70e9cfe3826d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:26 devstack sudo[86022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6d374efd-3049-44d5-bf8c-29f301e91d89.b681ef54-5369-4dfc-8130-70e9cfe3826d Apr 28 19:15:26 devstack sudo[86022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:27 devstack sudo[86022]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e763206-d8c9-475a-8ade-f86297b3b72b tempest-GroupSnapshotsV319Test-2073677593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6d374efd-3049-44d5-bf8c-29f301e91d89.b681ef54-5369-4dfc-8130-70e9cfe3826d" returned: 0 in 0.853s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:27 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:SELECT=60,cinder:UPDATE=85,cinder:INSERT=24,cinder:DELETE=9 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 19:15:27 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:UPDATE=88,cinder:SELECT=68,cinder:INSERT=16,cinder:DELETE=6 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 19:15:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e763206-d8c9-475a-8ade-f86297b3b72b tempest-GroupSnapshotsV319Test-2073677593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6d374efd-3049-44d5-bf8c-29f301e91d89.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:27 devstack sudo[86026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6d374efd-3049-44d5-bf8c-29f301e91d89.info Apr 28 19:15:27 devstack sudo[86026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:28 devstack sudo[86026]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e763206-d8c9-475a-8ade-f86297b3b72b tempest-GroupSnapshotsV319Test-2073677593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6d374efd-3049-44d5-bf8c-29f301e91d89.info" returned: 0 in 0.841s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:28 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-3e763206-d8c9-475a-8ade-f86297b3b72b tempest-GroupSnapshotsV319Test-2073677593 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6d374efd-3049-44d5-bf8c-29f301e91d89.info is being set with open permissions: ugo+rw: NotImplementedError Apr 28 19:15:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e763206-d8c9-475a-8ade-f86297b3b72b tempest-GroupSnapshotsV319Test-2073677593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6d374efd-3049-44d5-bf8c-29f301e91d89.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:28 devstack sudo[86029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6d374efd-3049-44d5-bf8c-29f301e91d89.info Apr 28 19:15:28 devstack sudo[86029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:29 devstack sudo[86029]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e763206-d8c9-475a-8ade-f86297b3b72b tempest-GroupSnapshotsV319Test-2073677593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6d374efd-3049-44d5-bf8c-29f301e91d89.info" returned: 0 in 0.760s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3e763206-d8c9-475a-8ade-f86297b3b72b tempest-GroupSnapshotsV319Test-2073677593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.227s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:15:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fa955f8f-5c4f-46da-aee9-a2f7e0c64923 tempest-DeleteServersTestJSON-1034568749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.247s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:15:29 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-fa955f8f-5c4f-46da-aee9-a2f7e0c64923 tempest-DeleteServersTestJSON-1034568749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1846009302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e50ff44-c79c-43b1-955d-fc92f513c0f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea9ab8b1f1cc412199903c5aa482d4df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:15:25Z,use_quota=True,user_id='f1680a4a29ba4a7d92fe16c59c916bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:15:29 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-fa955f8f-5c4f-46da-aee9-a2f7e0c64923 tempest-DeleteServersTestJSON-1034568749 None] Creating volume 5e50ff44-c79c-43b1-955d-fc92f513c0f5 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:15:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fa955f8f-5c4f-46da-aee9-a2f7e0c64923 tempest-DeleteServersTestJSON-1034568749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:15:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fa955f8f-5c4f-46da-aee9-a2f7e0c64923 tempest-DeleteServersTestJSON-1034568749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:15:29 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-fa955f8f-5c4f-46da-aee9-a2f7e0c64923 tempest-DeleteServersTestJSON-1034568749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:15:29 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-fa955f8f-5c4f-46da-aee9-a2f7e0c64923 tempest-DeleteServersTestJSON-1034568749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:15:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fa955f8f-5c4f-46da-aee9-a2f7e0c64923 tempest-DeleteServersTestJSON-1034568749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:15:29 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-fa955f8f-5c4f-46da-aee9-a2f7e0c64923 tempest-DeleteServersTestJSON-1034568749 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:15:29 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-fa955f8f-5c4f-46da-aee9-a2f7e0c64923 tempest-DeleteServersTestJSON-1034568749 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:15:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fa955f8f-5c4f-46da-aee9-a2f7e0c64923 tempest-DeleteServersTestJSON-1034568749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5e50ff44-c79c-43b1-955d-fc92f513c0f5 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:29 devstack sudo[86032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5e50ff44-c79c-43b1-955d-fc92f513c0f5 1073741824 Apr 28 19:15:29 devstack sudo[86032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:29 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-3e763206-d8c9-475a-8ade-f86297b3b72b tempest-GroupSnapshotsV319Test-2073677593 None] group_snapshot 39d84351-723e-428f-b7e4-650dca1cd0fc: created successfully Apr 28 19:15:30 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-6afee302-0c56-4874-af43-d4e7f017a7b7 tempest-VolumesTestJSON-2089928167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:15:30 devstack sudo[86032]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6afee302-0c56-4874-af43-d4e7f017a7b7 tempest-VolumesTestJSON-2089928167 None] Flow 'volume_create_manager' (257b49c1-a143-485e-9ea7-da372b6d8e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:15:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6afee302-0c56-4874-af43-d4e7f017a7b7 tempest-VolumesTestJSON-2089928167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e49df5b-cc1c-4451-a0ef-ec3e1ffc19af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fa955f8f-5c4f-46da-aee9-a2f7e0c64923 tempest-DeleteServersTestJSON-1034568749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5e50ff44-c79c-43b1-955d-fc92f513c0f5 1073741824" returned: 0 in 1.243s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6afee302-0c56-4874-af43-d4e7f017a7b7 tempest-VolumesTestJSON-2089928167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e49df5b-cc1c-4451-a0ef-ec3e1ffc19af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1106869764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f75ff9c6-f811-4ca4-8c53-e585047973ae,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3aaff6754137492a834fc3e0832fa262',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:15:30Z,use_quota=True,user_id='cb92d74bfe004566babf559197ce7cf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6afee302-0c56-4874-af43-d4e7f017a7b7 tempest-VolumesTestJSON-2089928167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (166a16ef-c117-43af-a8e6-d57a0c188d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6afee302-0c56-4874-af43-d4e7f017a7b7 tempest-VolumesTestJSON-2089928167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (166a16ef-c117-43af-a8e6-d57a0c188d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6afee302-0c56-4874-af43-d4e7f017a7b7 tempest-VolumesTestJSON-2089928167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d932d5f0-89f9-4327-a787-e5a7055822b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6afee302-0c56-4874-af43-d4e7f017a7b7 tempest-VolumesTestJSON-2089928167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d932d5f0-89f9-4327-a787-e5a7055822b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f75ff9c6-f811-4ca4-8c53-e585047973ae', 'volume_name': 'volume-f75ff9c6-f811-4ca4-8c53-e585047973ae', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6afee302-0c56-4874-af43-d4e7f017a7b7 tempest-VolumesTestJSON-2089928167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8032f59-ef10-4495-b043-6c5d541779aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6afee302-0c56-4874-af43-d4e7f017a7b7 tempest-VolumesTestJSON-2089928167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8032f59-ef10-4495-b043-6c5d541779aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6afee302-0c56-4874-af43-d4e7f017a7b7 tempest-VolumesTestJSON-2089928167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b64625a-3404-4124-ba7e-a267507dead3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:30 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-6afee302-0c56-4874-af43-d4e7f017a7b7 tempest-VolumesTestJSON-2089928167 None] Volume f75ff9c6-f811-4ca4-8c53-e585047973ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f75ff9c6-f811-4ca4-8c53-e585047973ae', 'volume_size': 1} Apr 28 19:15:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6afee302-0c56-4874-af43-d4e7f017a7b7 tempest-VolumesTestJSON-2089928167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:15:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fa955f8f-5c4f-46da-aee9-a2f7e0c64923 tempest-DeleteServersTestJSON-1034568749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5e50ff44-c79c-43b1-955d-fc92f513c0f5 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:30 devstack sudo[86073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5e50ff44-c79c-43b1-955d-fc92f513c0f5 Apr 28 19:15:30 devstack sudo[86073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:31 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-a7a8a3f7-da24-439c-b6d0-69c6cc58812c tempest-GroupSnapshotsV319Test-2073677593 None] group_snapshot 39d84351-723e-428f-b7e4-650dca1cd0fc: deleting Apr 28 19:15:31 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a7a8a3f7-da24-439c-b6d0-69c6cc58812c tempest-GroupSnapshotsV319Test-2073677593 None] group_snapshot 39d84351-723e-428f-b7e4-650dca1cd0fc: deleting {{(pid=83863) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 28 19:15:31 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a7a8a3f7-da24-439c-b6d0-69c6cc58812c tempest-GroupSnapshotsV319Test-2073677593 None] Acquiring lock "cinder-quobyte-6d374efd-3049-44d5-bf8c-29f301e91d89" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:15:31 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a7a8a3f7-da24-439c-b6d0-69c6cc58812c tempest-GroupSnapshotsV319Test-2073677593 None] Lock "cinder-quobyte-6d374efd-3049-44d5-bf8c-29f301e91d89" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:15:31 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a7a8a3f7-da24-439c-b6d0-69c6cc58812c tempest-GroupSnapshotsV319Test-2073677593 None] Acquiring lock "cinder-quobyte-b681ef54-5369-4dfc-8130-70e9cfe3826d" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:15:31 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a7a8a3f7-da24-439c-b6d0-69c6cc58812c tempest-GroupSnapshotsV319Test-2073677593 None] Lock "cinder-quobyte-b681ef54-5369-4dfc-8130-70e9cfe3826d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:15:31 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-a7a8a3f7-da24-439c-b6d0-69c6cc58812c tempest-GroupSnapshotsV319Test-2073677593 None] Deleting offline snapshot b681ef54-5369-4dfc-8130-70e9cfe3826d of volume 6d374efd-3049-44d5-bf8c-29f301e91d89 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 19:15:31 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-a7a8a3f7-da24-439c-b6d0-69c6cc58812c tempest-GroupSnapshotsV319Test-2073677593 None] snapshot_file for this snap is: volume-6d374efd-3049-44d5-bf8c-29f301e91d89.b681ef54-5369-4dfc-8130-70e9cfe3826d {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 19:15:31 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50f81e9-e3cf-4c9f-aa25-65bd0066e38a]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:15:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a7a8a3f7-da24-439c-b6d0-69c6cc58812c tempest-GroupSnapshotsV319Test-2073677593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6d374efd-3049-44d5-bf8c-29f301e91d89.b681ef54-5369-4dfc-8130-70e9cfe3826d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:31 devstack sudo[86077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6d374efd-3049-44d5-bf8c-29f301e91d89.b681ef54-5369-4dfc-8130-70e9cfe3826d Apr 28 19:15:31 devstack sudo[86077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:31 devstack sudo[86073]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fa955f8f-5c4f-46da-aee9-a2f7e0c64923 tempest-DeleteServersTestJSON-1034568749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5e50ff44-c79c-43b1-955d-fc92f513c0f5" returned: 0 in 1.101s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:31 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-fa955f8f-5c4f-46da-aee9-a2f7e0c64923 tempest-DeleteServersTestJSON-1034568749 None] <== create_volume: return (2481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:15:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fa955f8f-5c4f-46da-aee9-a2f7e0c64923 tempest-DeleteServersTestJSON-1034568749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.487s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:15:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6afee302-0c56-4874-af43-d4e7f017a7b7 tempest-VolumesTestJSON-2089928167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.147s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:15:31 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6afee302-0c56-4874-af43-d4e7f017a7b7 tempest-VolumesTestJSON-2089928167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1106869764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f75ff9c6-f811-4ca4-8c53-e585047973ae,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3aaff6754137492a834fc3e0832fa262',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:15:30Z,use_quota=True,user_id='cb92d74bfe004566babf559197ce7cf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:15:31 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-6afee302-0c56-4874-af43-d4e7f017a7b7 tempest-VolumesTestJSON-2089928167 None] Creating volume f75ff9c6-f811-4ca4-8c53-e585047973ae {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:15:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6afee302-0c56-4874-af43-d4e7f017a7b7 tempest-VolumesTestJSON-2089928167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:15:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6afee302-0c56-4874-af43-d4e7f017a7b7 tempest-VolumesTestJSON-2089928167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:15:31 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6afee302-0c56-4874-af43-d4e7f017a7b7 tempest-VolumesTestJSON-2089928167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:15:31 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6afee302-0c56-4874-af43-d4e7f017a7b7 tempest-VolumesTestJSON-2089928167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:15:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6afee302-0c56-4874-af43-d4e7f017a7b7 tempest-VolumesTestJSON-2089928167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:15:31 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6afee302-0c56-4874-af43-d4e7f017a7b7 tempest-VolumesTestJSON-2089928167 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:15:31 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-6afee302-0c56-4874-af43-d4e7f017a7b7 tempest-VolumesTestJSON-2089928167 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:15:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6afee302-0c56-4874-af43-d4e7f017a7b7 tempest-VolumesTestJSON-2089928167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f75ff9c6-f811-4ca4-8c53-e585047973ae 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:31 devstack sudo[86080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f75ff9c6-f811-4ca4-8c53-e585047973ae 1073741824 Apr 28 19:15:31 devstack sudo[86080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:31 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fa955f8f-5c4f-46da-aee9-a2f7e0c64923 tempest-DeleteServersTestJSON-1034568749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d055843-d92d-4812-9a0d-fb582e0e088d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e50ff44-c79c-43b1-955d-fc92f513c0f5', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:31 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fa955f8f-5c4f-46da-aee9-a2f7e0c64923 tempest-DeleteServersTestJSON-1034568749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f83af00b-e5a8-48f2-8b2d-0c164e94bccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:31 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-fa955f8f-5c4f-46da-aee9-a2f7e0c64923 tempest-DeleteServersTestJSON-1034568749 None] Volume volume-5e50ff44-c79c-43b1-955d-fc92f513c0f5 (5e50ff44-c79c-43b1-955d-fc92f513c0f5): created successfully Apr 28 19:15:31 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fa955f8f-5c4f-46da-aee9-a2f7e0c64923 tempest-DeleteServersTestJSON-1034568749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f83af00b-e5a8-48f2-8b2d-0c164e94bccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:31 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fa955f8f-5c4f-46da-aee9-a2f7e0c64923 tempest-DeleteServersTestJSON-1034568749 None] Flow 'volume_create_manager' (167c4716-2007-465a-803a-82fbaef82e17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:15:31 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-fa955f8f-5c4f-46da-aee9-a2f7e0c64923 tempest-DeleteServersTestJSON-1034568749 None] Created volume successfully. Apr 28 19:15:32 devstack sudo[86077]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a7a8a3f7-da24-439c-b6d0-69c6cc58812c tempest-GroupSnapshotsV319Test-2073677593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6d374efd-3049-44d5-bf8c-29f301e91d89.b681ef54-5369-4dfc-8130-70e9cfe3826d" returned: 0 in 1.040s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:32 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-a7a8a3f7-da24-439c-b6d0-69c6cc58812c tempest-GroupSnapshotsV319Test-2073677593 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d374efd-3049-44d5-bf8c-29f301e91d89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:15:32 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ba8536-0345-4b00-81b1-485e129e1e48]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:15:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a7a8a3f7-da24-439c-b6d0-69c6cc58812c tempest-GroupSnapshotsV319Test-2073677593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6d374efd-3049-44d5-bf8c-29f301e91d89 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:32 devstack sudo[86088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6d374efd-3049-44d5-bf8c-29f301e91d89 Apr 28 19:15:32 devstack sudo[86088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:33 devstack sudo[86080]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6afee302-0c56-4874-af43-d4e7f017a7b7 tempest-VolumesTestJSON-2089928167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f75ff9c6-f811-4ca4-8c53-e585047973ae 1073741824" returned: 0 in 1.213s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6afee302-0c56-4874-af43-d4e7f017a7b7 tempest-VolumesTestJSON-2089928167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f75ff9c6-f811-4ca4-8c53-e585047973ae {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:33 devstack sudo[86091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f75ff9c6-f811-4ca4-8c53-e585047973ae Apr 28 19:15:33 devstack sudo[86091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:33 devstack sudo[86088]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a7a8a3f7-da24-439c-b6d0-69c6cc58812c tempest-GroupSnapshotsV319Test-2073677593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6d374efd-3049-44d5-bf8c-29f301e91d89" returned: 0 in 1.050s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a7a8a3f7-da24-439c-b6d0-69c6cc58812c tempest-GroupSnapshotsV319Test-2073677593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6d374efd-3049-44d5-bf8c-29f301e91d89.b681ef54-5369-4dfc-8130-70e9cfe3826d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:33 devstack sudo[86102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6d374efd-3049-44d5-bf8c-29f301e91d89.b681ef54-5369-4dfc-8130-70e9cfe3826d Apr 28 19:15:33 devstack sudo[86102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:33 devstack sudo[86091]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6afee302-0c56-4874-af43-d4e7f017a7b7 tempest-VolumesTestJSON-2089928167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f75ff9c6-f811-4ca4-8c53-e585047973ae" returned: 0 in 0.922s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:34 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6afee302-0c56-4874-af43-d4e7f017a7b7 tempest-VolumesTestJSON-2089928167 None] <== create_volume: return (2213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:15:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6afee302-0c56-4874-af43-d4e7f017a7b7 tempest-VolumesTestJSON-2089928167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.217s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:15:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6afee302-0c56-4874-af43-d4e7f017a7b7 tempest-VolumesTestJSON-2089928167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b64625a-3404-4124-ba7e-a267507dead3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f75ff9c6-f811-4ca4-8c53-e585047973ae', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6afee302-0c56-4874-af43-d4e7f017a7b7 tempest-VolumesTestJSON-2089928167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ac3613-d261-468d-889e-ae0913ce5399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:34 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-6afee302-0c56-4874-af43-d4e7f017a7b7 tempest-VolumesTestJSON-2089928167 None] Volume volume-f75ff9c6-f811-4ca4-8c53-e585047973ae (f75ff9c6-f811-4ca4-8c53-e585047973ae): created successfully Apr 28 19:15:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6afee302-0c56-4874-af43-d4e7f017a7b7 tempest-VolumesTestJSON-2089928167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ac3613-d261-468d-889e-ae0913ce5399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6afee302-0c56-4874-af43-d4e7f017a7b7 tempest-VolumesTestJSON-2089928167 None] Flow 'volume_create_manager' (257b49c1-a143-485e-9ea7-da372b6d8e7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:15:34 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-6afee302-0c56-4874-af43-d4e7f017a7b7 tempest-VolumesTestJSON-2089928167 None] Created volume successfully. Apr 28 19:15:34 devstack sudo[86102]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a7a8a3f7-da24-439c-b6d0-69c6cc58812c tempest-GroupSnapshotsV319Test-2073677593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6d374efd-3049-44d5-bf8c-29f301e91d89.b681ef54-5369-4dfc-8130-70e9cfe3826d" returned: 0 in 0.894s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a7a8a3f7-da24-439c-b6d0-69c6cc58812c tempest-GroupSnapshotsV319Test-2073677593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6d374efd-3049-44d5-bf8c-29f301e91d89.b681ef54-5369-4dfc-8130-70e9cfe3826d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:34 devstack sudo[86124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6d374efd-3049-44d5-bf8c-29f301e91d89.b681ef54-5369-4dfc-8130-70e9cfe3826d Apr 28 19:15:34 devstack sudo[86124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:35 devstack sudo[86124]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a7a8a3f7-da24-439c-b6d0-69c6cc58812c tempest-GroupSnapshotsV319Test-2073677593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6d374efd-3049-44d5-bf8c-29f301e91d89.b681ef54-5369-4dfc-8130-70e9cfe3826d" returned: 0 in 0.667s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:35 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a7a8a3f7-da24-439c-b6d0-69c6cc58812c tempest-GroupSnapshotsV319Test-2073677593 None] Lock "cinder-quobyte-b681ef54-5369-4dfc-8130-70e9cfe3826d" released by "_delete_snapshot" :: held 3.760s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:15:35 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a7a8a3f7-da24-439c-b6d0-69c6cc58812c tempest-GroupSnapshotsV319Test-2073677593 None] Lock "cinder-quobyte-6d374efd-3049-44d5-bf8c-29f301e91d89" released by "delete_snapshot" :: held 3.786s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:15:35 devstack cinder-volume[83863]: WARNING cinder.quota [None req-a7a8a3f7-da24-439c-b6d0-69c6cc58812c tempest-GroupSnapshotsV319Test-2073677593 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-309232685 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-309232685, it is now deprecated. Please use the default quota class for default quota. Apr 28 19:15:35 devstack cinder-volume[83863]: WARNING cinder.quota [None req-a7a8a3f7-da24-439c-b6d0-69c6cc58812c tempest-GroupSnapshotsV319Test-2073677593 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-309232685 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-309232685, it is now deprecated. Please use the default quota class for default quota. Apr 28 19:15:35 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-a7a8a3f7-da24-439c-b6d0-69c6cc58812c tempest-GroupSnapshotsV319Test-2073677593 None] Created reservations ['0247ef3f-86b7-4259-aa22-16a57df2187e', '96de70a2-a0a0-420e-b025-4b752e88d39f', '3b7b1e15-2f06-4f29-92b8-33a9a78c74a1', 'f786ef22-a240-4c88-9aed-94d94118583a'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:15:35 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-a7a8a3f7-da24-439c-b6d0-69c6cc58812c tempest-GroupSnapshotsV319Test-2073677593 None] group_snapshot 39d84351-723e-428f-b7e4-650dca1cd0fc: deleted successfully Apr 28 19:15:35 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa25e2ab-0ded-432e-9b2c-07ee5735e33a tempest-VolumesTestJSON-2089928167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:15:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fa25e2ab-0ded-432e-9b2c-07ee5735e33a tempest-VolumesTestJSON-2089928167 None] Flow 'volume_create_manager' (2f3dfdf1-0b35-4922-8657-9456439a3ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:15:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fa25e2ab-0ded-432e-9b2c-07ee5735e33a tempest-VolumesTestJSON-2089928167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (797c881f-1914-41e9-8bf2-9d45c21311ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fa25e2ab-0ded-432e-9b2c-07ee5735e33a tempest-VolumesTestJSON-2089928167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (797c881f-1914-41e9-8bf2-9d45c21311ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:15:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-35531631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed89f4a6-d754-499b-b4e9-638229f9356c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3aaff6754137492a834fc3e0832fa262',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:15:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:15:36Z,use_quota=True,user_id='cb92d74bfe004566babf559197ce7cf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fa25e2ab-0ded-432e-9b2c-07ee5735e33a tempest-VolumesTestJSON-2089928167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd2a104b-d833-4f9f-8b63-79c9032bb35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fa25e2ab-0ded-432e-9b2c-07ee5735e33a tempest-VolumesTestJSON-2089928167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd2a104b-d833-4f9f-8b63-79c9032bb35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fa25e2ab-0ded-432e-9b2c-07ee5735e33a tempest-VolumesTestJSON-2089928167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53f1c2c0-77a2-4114-adcc-3dbf0a046ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fa25e2ab-0ded-432e-9b2c-07ee5735e33a tempest-VolumesTestJSON-2089928167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53f1c2c0-77a2-4114-adcc-3dbf0a046ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed89f4a6-d754-499b-b4e9-638229f9356c', 'volume_name': 'volume-ed89f4a6-d754-499b-b4e9-638229f9356c', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fa25e2ab-0ded-432e-9b2c-07ee5735e33a tempest-VolumesTestJSON-2089928167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (069f710d-fb7d-4e3a-80f4-47f807f2650b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fa25e2ab-0ded-432e-9b2c-07ee5735e33a tempest-VolumesTestJSON-2089928167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (069f710d-fb7d-4e3a-80f4-47f807f2650b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fa25e2ab-0ded-432e-9b2c-07ee5735e33a tempest-VolumesTestJSON-2089928167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e16c3f91-faa2-40d9-9565-1ccc5ca77ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:35 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-fa25e2ab-0ded-432e-9b2c-07ee5735e33a tempest-VolumesTestJSON-2089928167 None] Volume ed89f4a6-d754-499b-b4e9-638229f9356c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed89f4a6-d754-499b-b4e9-638229f9356c', 'volume_size': 1} Apr 28 19:15:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fa25e2ab-0ded-432e-9b2c-07ee5735e33a tempest-VolumesTestJSON-2089928167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:15:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fa25e2ab-0ded-432e-9b2c-07ee5735e33a tempest-VolumesTestJSON-2089928167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:15:35 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-fa25e2ab-0ded-432e-9b2c-07ee5735e33a tempest-VolumesTestJSON-2089928167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:15:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-35531631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed89f4a6-d754-499b-b4e9-638229f9356c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3aaff6754137492a834fc3e0832fa262',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:15:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:15:36Z,use_quota=True,user_id='cb92d74bfe004566babf559197ce7cf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:15:35 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-fa25e2ab-0ded-432e-9b2c-07ee5735e33a tempest-VolumesTestJSON-2089928167 None] Creating volume ed89f4a6-d754-499b-b4e9-638229f9356c {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:15:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fa25e2ab-0ded-432e-9b2c-07ee5735e33a tempest-VolumesTestJSON-2089928167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:15:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fa25e2ab-0ded-432e-9b2c-07ee5735e33a tempest-VolumesTestJSON-2089928167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:15:35 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-fa25e2ab-0ded-432e-9b2c-07ee5735e33a tempest-VolumesTestJSON-2089928167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:15:35 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-fa25e2ab-0ded-432e-9b2c-07ee5735e33a tempest-VolumesTestJSON-2089928167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:15:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fa25e2ab-0ded-432e-9b2c-07ee5735e33a tempest-VolumesTestJSON-2089928167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:15:35 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-fa25e2ab-0ded-432e-9b2c-07ee5735e33a tempest-VolumesTestJSON-2089928167 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:15:35 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-fa25e2ab-0ded-432e-9b2c-07ee5735e33a tempest-VolumesTestJSON-2089928167 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:15:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fa25e2ab-0ded-432e-9b2c-07ee5735e33a tempest-VolumesTestJSON-2089928167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ed89f4a6-d754-499b-b4e9-638229f9356c 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:35 devstack sudo[86128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ed89f4a6-d754-499b-b4e9-638229f9356c 1073741824 Apr 28 19:15:35 devstack sudo[86128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:36 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5c7b70d1-974a-4a5d-983a-9df6585ad529 tempest-GroupSnapshotsV319Test-2073677593 None] Acquiring lock "cinder-quobyte-6d374efd-3049-44d5-bf8c-29f301e91d89" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:15:36 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5c7b70d1-974a-4a5d-983a-9df6585ad529 tempest-GroupSnapshotsV319Test-2073677593 None] Lock "cinder-quobyte-6d374efd-3049-44d5-bf8c-29f301e91d89" acquired by "delete_volume" :: waited 0.027s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:15:36 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bce1bf3-3bad-47fc-8214-138004d08f1f]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:15:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5c7b70d1-974a-4a5d-983a-9df6585ad529 tempest-GroupSnapshotsV319Test-2073677593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6d374efd-3049-44d5-bf8c-29f301e91d89 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:36 devstack sudo[86131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6d374efd-3049-44d5-bf8c-29f301e91d89 Apr 28 19:15:36 devstack sudo[86131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:36 devstack sudo[86128]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fa25e2ab-0ded-432e-9b2c-07ee5735e33a tempest-VolumesTestJSON-2089928167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ed89f4a6-d754-499b-b4e9-638229f9356c 1073741824" returned: 0 in 0.925s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fa25e2ab-0ded-432e-9b2c-07ee5735e33a tempest-VolumesTestJSON-2089928167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ed89f4a6-d754-499b-b4e9-638229f9356c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:36 devstack sudo[86139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ed89f4a6-d754-499b-b4e9-638229f9356c Apr 28 19:15:36 devstack sudo[86139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:37 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-e827d89a-9390-4284-a893-a3dcf8263063 tempest-VolumesListAdminTestJSON-2014480160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:15:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e827d89a-9390-4284-a893-a3dcf8263063 tempest-VolumesListAdminTestJSON-2014480160 None] Flow 'volume_create_manager' (ef1d62a8-8505-45c7-8fb8-7f287e3db427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:15:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e827d89a-9390-4284-a893-a3dcf8263063 tempest-VolumesListAdminTestJSON-2014480160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f726ffdb-e1df-4c98-9714-dac2263ac2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e827d89a-9390-4284-a893-a3dcf8263063 tempest-VolumesListAdminTestJSON-2014480160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f726ffdb-e1df-4c98-9714-dac2263ac2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1075233779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d26ab357-1dbe-4e4d-9b4b-0b8927414ce8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05ad70ac35f54361b5c2ae5498d7ee27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:15:37Z,use_quota=True,user_id='2733cf6c08544a41b0412e82b6a1a218',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e827d89a-9390-4284-a893-a3dcf8263063 tempest-VolumesListAdminTestJSON-2014480160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6655abe3-13dd-477e-b9e2-1da792065d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e827d89a-9390-4284-a893-a3dcf8263063 tempest-VolumesListAdminTestJSON-2014480160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6655abe3-13dd-477e-b9e2-1da792065d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e827d89a-9390-4284-a893-a3dcf8263063 tempest-VolumesListAdminTestJSON-2014480160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e85f5515-c47a-4952-a7f7-e2c6a5181b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:37 devstack sudo[86131]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e827d89a-9390-4284-a893-a3dcf8263063 tempest-VolumesListAdminTestJSON-2014480160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e85f5515-c47a-4952-a7f7-e2c6a5181b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd26ab357-1dbe-4e4d-9b4b-0b8927414ce8', 'volume_name': 'volume-d26ab357-1dbe-4e4d-9b4b-0b8927414ce8', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e827d89a-9390-4284-a893-a3dcf8263063 tempest-VolumesListAdminTestJSON-2014480160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (985eb5f3-ce72-45eb-8270-223c81314fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e827d89a-9390-4284-a893-a3dcf8263063 tempest-VolumesListAdminTestJSON-2014480160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (985eb5f3-ce72-45eb-8270-223c81314fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e827d89a-9390-4284-a893-a3dcf8263063 tempest-VolumesListAdminTestJSON-2014480160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd1525e0-8dc7-470e-8440-681ea6eb1e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:37 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-e827d89a-9390-4284-a893-a3dcf8263063 tempest-VolumesListAdminTestJSON-2014480160 None] Volume d26ab357-1dbe-4e4d-9b4b-0b8927414ce8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d26ab357-1dbe-4e4d-9b4b-0b8927414ce8', 'volume_size': 1} Apr 28 19:15:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e827d89a-9390-4284-a893-a3dcf8263063 tempest-VolumesListAdminTestJSON-2014480160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:15:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5c7b70d1-974a-4a5d-983a-9df6585ad529 tempest-GroupSnapshotsV319Test-2073677593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6d374efd-3049-44d5-bf8c-29f301e91d89" returned: 0 in 0.975s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5c7b70d1-974a-4a5d-983a-9df6585ad529 tempest-GroupSnapshotsV319Test-2073677593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6d374efd-3049-44d5-bf8c-29f301e91d89 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:37 devstack sudo[86150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6d374efd-3049-44d5-bf8c-29f301e91d89 Apr 28 19:15:37 devstack sudo[86150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:37 devstack sudo[86139]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fa25e2ab-0ded-432e-9b2c-07ee5735e33a tempest-VolumesTestJSON-2089928167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ed89f4a6-d754-499b-b4e9-638229f9356c" returned: 0 in 0.723s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:37 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-fa25e2ab-0ded-432e-9b2c-07ee5735e33a tempest-VolumesTestJSON-2089928167 None] <== create_volume: return (1724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:15:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fa25e2ab-0ded-432e-9b2c-07ee5735e33a tempest-VolumesTestJSON-2089928167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.726s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:15:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e827d89a-9390-4284-a893-a3dcf8263063 tempest-VolumesListAdminTestJSON-2014480160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.270s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:15:37 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-e827d89a-9390-4284-a893-a3dcf8263063 tempest-VolumesListAdminTestJSON-2014480160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1075233779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d26ab357-1dbe-4e4d-9b4b-0b8927414ce8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05ad70ac35f54361b5c2ae5498d7ee27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:15:37Z,use_quota=True,user_id='2733cf6c08544a41b0412e82b6a1a218',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:15:37 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-e827d89a-9390-4284-a893-a3dcf8263063 tempest-VolumesListAdminTestJSON-2014480160 None] Creating volume d26ab357-1dbe-4e4d-9b4b-0b8927414ce8 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:15:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e827d89a-9390-4284-a893-a3dcf8263063 tempest-VolumesListAdminTestJSON-2014480160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:15:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e827d89a-9390-4284-a893-a3dcf8263063 tempest-VolumesListAdminTestJSON-2014480160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:15:37 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-e827d89a-9390-4284-a893-a3dcf8263063 tempest-VolumesListAdminTestJSON-2014480160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:15:37 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-e827d89a-9390-4284-a893-a3dcf8263063 tempest-VolumesListAdminTestJSON-2014480160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:15:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e827d89a-9390-4284-a893-a3dcf8263063 tempest-VolumesListAdminTestJSON-2014480160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:15:37 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-e827d89a-9390-4284-a893-a3dcf8263063 tempest-VolumesListAdminTestJSON-2014480160 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:15:37 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-e827d89a-9390-4284-a893-a3dcf8263063 tempest-VolumesListAdminTestJSON-2014480160 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:15:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e827d89a-9390-4284-a893-a3dcf8263063 tempest-VolumesListAdminTestJSON-2014480160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d26ab357-1dbe-4e4d-9b4b-0b8927414ce8 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:37 devstack sudo[86154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d26ab357-1dbe-4e4d-9b4b-0b8927414ce8 1073741824 Apr 28 19:15:37 devstack sudo[86154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fa25e2ab-0ded-432e-9b2c-07ee5735e33a tempest-VolumesTestJSON-2089928167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e16c3f91-faa2-40d9-9565-1ccc5ca77ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed89f4a6-d754-499b-b4e9-638229f9356c', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fa25e2ab-0ded-432e-9b2c-07ee5735e33a tempest-VolumesTestJSON-2089928167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd8727de-81a1-4df9-a19e-ace3db264c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:37 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-fa25e2ab-0ded-432e-9b2c-07ee5735e33a tempest-VolumesTestJSON-2089928167 None] Volume volume-ed89f4a6-d754-499b-b4e9-638229f9356c (ed89f4a6-d754-499b-b4e9-638229f9356c): created successfully Apr 28 19:15:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fa25e2ab-0ded-432e-9b2c-07ee5735e33a tempest-VolumesTestJSON-2089928167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd8727de-81a1-4df9-a19e-ace3db264c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fa25e2ab-0ded-432e-9b2c-07ee5735e33a tempest-VolumesTestJSON-2089928167 None] Flow 'volume_create_manager' (2f3dfdf1-0b35-4922-8657-9456439a3ec0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:15:37 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-fa25e2ab-0ded-432e-9b2c-07ee5735e33a tempest-VolumesTestJSON-2089928167 None] Created volume successfully. Apr 28 19:15:38 devstack sudo[86150]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5c7b70d1-974a-4a5d-983a-9df6585ad529 tempest-GroupSnapshotsV319Test-2073677593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6d374efd-3049-44d5-bf8c-29f301e91d89" returned: 0 in 0.684s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:38 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5c7b70d1-974a-4a5d-983a-9df6585ad529 tempest-GroupSnapshotsV319Test-2073677593 None] Lock "cinder-quobyte-6d374efd-3049-44d5-bf8c-29f301e91d89" released by "delete_volume" :: held 1.738s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:15:38 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-5c7b70d1-974a-4a5d-983a-9df6585ad529 tempest-GroupSnapshotsV319Test-2073677593 None] Created reservations ['c8e9e04c-6439-4be5-aa24-99b946a98f36'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:15:38 devstack cinder-volume[83863]: WARNING cinder.quota [None req-5c7b70d1-974a-4a5d-983a-9df6585ad529 tempest-GroupSnapshotsV319Test-2073677593 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-309232685 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-309232685, it is now deprecated. Please use the default quota class for default quota. Apr 28 19:15:38 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-5c7b70d1-974a-4a5d-983a-9df6585ad529 tempest-GroupSnapshotsV319Test-2073677593 None] Created reservations ['8e174eaf-719d-4ad8-bc06-d3d7f3fa9c8d', 'ec5aa85d-0453-42dd-8f3e-bdbc78019b69', 'ebaba12e-9ad5-4108-8ef5-f20db6237641', '8a6e516d-4525-4b99-82bd-f3d65e098d18'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:15:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5c7b70d1-974a-4a5d-983a-9df6585ad529 tempest-GroupSnapshotsV319Test-2073677593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:15:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5c7b70d1-974a-4a5d-983a-9df6585ad529 tempest-GroupSnapshotsV319Test-2073677593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:15:38 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5c7b70d1-974a-4a5d-983a-9df6585ad529 tempest-GroupSnapshotsV319Test-2073677593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:15:38 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5c7b70d1-974a-4a5d-983a-9df6585ad529 tempest-GroupSnapshotsV319Test-2073677593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:15:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5c7b70d1-974a-4a5d-983a-9df6585ad529 tempest-GroupSnapshotsV319Test-2073677593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:15:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5c7b70d1-974a-4a5d-983a-9df6585ad529 tempest-GroupSnapshotsV319Test-2073677593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:38 devstack sudo[86161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:15:38 devstack sudo[86161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:38 devstack sudo[86154]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e827d89a-9390-4284-a893-a3dcf8263063 tempest-VolumesListAdminTestJSON-2014480160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d26ab357-1dbe-4e4d-9b4b-0b8927414ce8 1073741824" returned: 0 in 0.918s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e827d89a-9390-4284-a893-a3dcf8263063 tempest-VolumesListAdminTestJSON-2014480160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d26ab357-1dbe-4e4d-9b4b-0b8927414ce8 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:38 devstack sudo[86165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d26ab357-1dbe-4e4d-9b4b-0b8927414ce8 Apr 28 19:15:38 devstack sudo[86165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:38 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-16a81449-2c08-4b0e-8371-68e610fd3c50 tempest-VolumesTestJSON-2089928167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:15:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-16a81449-2c08-4b0e-8371-68e610fd3c50 tempest-VolumesTestJSON-2089928167 None] Flow 'volume_create_manager' (a8737cd4-2297-497d-8997-01e4b82de03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:15:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-16a81449-2c08-4b0e-8371-68e610fd3c50 tempest-VolumesTestJSON-2089928167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5e0800a-e821-462c-abc6-157722b8f420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-16a81449-2c08-4b0e-8371-68e610fd3c50 tempest-VolumesTestJSON-2089928167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5e0800a-e821-462c-abc6-157722b8f420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1970916503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45026d2c-f497-403b-b357-0370acf3b884,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3aaff6754137492a834fc3e0832fa262',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:15:39Z,use_quota=True,user_id='cb92d74bfe004566babf559197ce7cf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-16a81449-2c08-4b0e-8371-68e610fd3c50 tempest-VolumesTestJSON-2089928167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd1a63c2-364b-47ca-a21d-fb976f0bfafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-16a81449-2c08-4b0e-8371-68e610fd3c50 tempest-VolumesTestJSON-2089928167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd1a63c2-364b-47ca-a21d-fb976f0bfafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-16a81449-2c08-4b0e-8371-68e610fd3c50 tempest-VolumesTestJSON-2089928167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41ae7869-7cc3-4ebb-92ea-8028c6bc8617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-16a81449-2c08-4b0e-8371-68e610fd3c50 tempest-VolumesTestJSON-2089928167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41ae7869-7cc3-4ebb-92ea-8028c6bc8617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45026d2c-f497-403b-b357-0370acf3b884', 'volume_name': 'volume-45026d2c-f497-403b-b357-0370acf3b884', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-16a81449-2c08-4b0e-8371-68e610fd3c50 tempest-VolumesTestJSON-2089928167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63344074-ab2f-49b5-87d3-50da23905695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-16a81449-2c08-4b0e-8371-68e610fd3c50 tempest-VolumesTestJSON-2089928167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63344074-ab2f-49b5-87d3-50da23905695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-16a81449-2c08-4b0e-8371-68e610fd3c50 tempest-VolumesTestJSON-2089928167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47b24a5b-9ce1-45fd-b66b-8a88dafe1e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:38 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-16a81449-2c08-4b0e-8371-68e610fd3c50 tempest-VolumesTestJSON-2089928167 None] Volume 45026d2c-f497-403b-b357-0370acf3b884: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45026d2c-f497-403b-b357-0370acf3b884', 'volume_size': 1} Apr 28 19:15:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-16a81449-2c08-4b0e-8371-68e610fd3c50 tempest-VolumesTestJSON-2089928167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:15:39 devstack sudo[86161]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5c7b70d1-974a-4a5d-983a-9df6585ad529 tempest-GroupSnapshotsV319Test-2073677593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.949s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:39 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-5c7b70d1-974a-4a5d-983a-9df6585ad529 tempest-GroupSnapshotsV319Test-2073677593 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:15:39 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-5c7b70d1-974a-4a5d-983a-9df6585ad529 tempest-GroupSnapshotsV319Test-2073677593 None] Delete group completed successfully. Apr 28 19:15:39 devstack cinder-volume[83863]: WARNING py.warnings [req-45c15bad-e30a-4ee1-ae95-69e68bb85389 req-83ea714e-0819-42f5-bf16-a7ec28c088ec tempest-DeleteServersTestJSON-1034568749 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Apr 28 19:15:39 devstack cinder-volume[83863]: .first() Apr 28 19:15:39 devstack cinder-volume[83863]: Apr 28 19:15:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-45c15bad-e30a-4ee1-ae95-69e68bb85389 req-83ea714e-0819-42f5-bf16-a7ec28c088ec tempest-DeleteServersTestJSON-1034568749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:15:39 devstack sudo[86165]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e827d89a-9390-4284-a893-a3dcf8263063 tempest-VolumesListAdminTestJSON-2014480160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d26ab357-1dbe-4e4d-9b4b-0b8927414ce8" returned: 0 in 0.851s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:39 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-e827d89a-9390-4284-a893-a3dcf8263063 tempest-VolumesListAdminTestJSON-2014480160 None] <== create_volume: return (1862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:15:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e827d89a-9390-4284-a893-a3dcf8263063 tempest-VolumesListAdminTestJSON-2014480160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.866s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:15:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-16a81449-2c08-4b0e-8371-68e610fd3c50 tempest-VolumesTestJSON-2089928167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.571s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:15:39 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-16a81449-2c08-4b0e-8371-68e610fd3c50 tempest-VolumesTestJSON-2089928167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1970916503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45026d2c-f497-403b-b357-0370acf3b884,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3aaff6754137492a834fc3e0832fa262',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:15:39Z,use_quota=True,user_id='cb92d74bfe004566babf559197ce7cf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:15:39 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-16a81449-2c08-4b0e-8371-68e610fd3c50 tempest-VolumesTestJSON-2089928167 None] Creating volume 45026d2c-f497-403b-b357-0370acf3b884 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:15:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-16a81449-2c08-4b0e-8371-68e610fd3c50 tempest-VolumesTestJSON-2089928167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:15:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-16a81449-2c08-4b0e-8371-68e610fd3c50 tempest-VolumesTestJSON-2089928167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:15:39 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-16a81449-2c08-4b0e-8371-68e610fd3c50 tempest-VolumesTestJSON-2089928167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:15:39 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-16a81449-2c08-4b0e-8371-68e610fd3c50 tempest-VolumesTestJSON-2089928167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:15:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-16a81449-2c08-4b0e-8371-68e610fd3c50 tempest-VolumesTestJSON-2089928167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:15:39 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-16a81449-2c08-4b0e-8371-68e610fd3c50 tempest-VolumesTestJSON-2089928167 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:15:39 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-16a81449-2c08-4b0e-8371-68e610fd3c50 tempest-VolumesTestJSON-2089928167 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:15:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-16a81449-2c08-4b0e-8371-68e610fd3c50 tempest-VolumesTestJSON-2089928167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-45026d2c-f497-403b-b357-0370acf3b884 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e827d89a-9390-4284-a893-a3dcf8263063 tempest-VolumesListAdminTestJSON-2014480160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd1525e0-8dc7-470e-8440-681ea6eb1e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d26ab357-1dbe-4e4d-9b4b-0b8927414ce8', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:39 devstack sudo[86179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-45026d2c-f497-403b-b357-0370acf3b884 1073741824 Apr 28 19:15:39 devstack sudo[86179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e827d89a-9390-4284-a893-a3dcf8263063 tempest-VolumesListAdminTestJSON-2014480160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13a69e6d-b4a0-4aad-8536-2df0ab976258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:39 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-e827d89a-9390-4284-a893-a3dcf8263063 tempest-VolumesListAdminTestJSON-2014480160 None] Volume volume-d26ab357-1dbe-4e4d-9b4b-0b8927414ce8 (d26ab357-1dbe-4e4d-9b4b-0b8927414ce8): created successfully Apr 28 19:15:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e827d89a-9390-4284-a893-a3dcf8263063 tempest-VolumesListAdminTestJSON-2014480160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13a69e6d-b4a0-4aad-8536-2df0ab976258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e827d89a-9390-4284-a893-a3dcf8263063 tempest-VolumesListAdminTestJSON-2014480160 None] Flow 'volume_create_manager' (ef1d62a8-8505-45c7-8fb8-7f287e3db427) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:15:39 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-e827d89a-9390-4284-a893-a3dcf8263063 tempest-VolumesListAdminTestJSON-2014480160 None] Created volume successfully. Apr 28 19:15:40 devstack sudo[86179]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-16a81449-2c08-4b0e-8371-68e610fd3c50 tempest-VolumesTestJSON-2089928167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-45026d2c-f497-403b-b357-0370acf3b884 1073741824" returned: 0 in 0.826s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-16a81449-2c08-4b0e-8371-68e610fd3c50 tempest-VolumesTestJSON-2089928167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-45026d2c-f497-403b-b357-0370acf3b884 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:40 devstack sudo[86184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-45026d2c-f497-403b-b357-0370acf3b884 Apr 28 19:15:40 devstack sudo[86184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:41 devstack sudo[86184]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-16a81449-2c08-4b0e-8371-68e610fd3c50 tempest-VolumesTestJSON-2089928167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-45026d2c-f497-403b-b357-0370acf3b884" returned: 0 in 0.746s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:41 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-16a81449-2c08-4b0e-8371-68e610fd3c50 tempest-VolumesTestJSON-2089928167 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:15:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-16a81449-2c08-4b0e-8371-68e610fd3c50 tempest-VolumesTestJSON-2089928167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:15:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-45c15bad-e30a-4ee1-ae95-69e68bb85389 req-83ea714e-0819-42f5-bf16-a7ec28c088ec tempest-DeleteServersTestJSON-1034568749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.663s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:15:41 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-699b61cd-d0ef-438d-9641-2ef85e0856a9 tempest-VolumesListAdminTestJSON-2014480160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:15:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-699b61cd-d0ef-438d-9641-2ef85e0856a9 tempest-VolumesListAdminTestJSON-2014480160 None] Flow 'volume_create_manager' (f62752b5-2431-4005-b45d-1cb5bbe47c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:15:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-699b61cd-d0ef-438d-9641-2ef85e0856a9 tempest-VolumesListAdminTestJSON-2014480160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c83fc9b1-d0f1-4638-91ce-c2a0726b50ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:41 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c2a42e-ce7f-4dc9-8192-8028dbb479e4]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:15:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-45c15bad-e30a-4ee1-ae95-69e68bb85389 req-83ea714e-0819-42f5-bf16-a7ec28c088ec tempest-DeleteServersTestJSON-1034568749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5e50ff44-c79c-43b1-955d-fc92f513c0f5 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-699b61cd-d0ef-438d-9641-2ef85e0856a9 tempest-VolumesListAdminTestJSON-2014480160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c83fc9b1-d0f1-4638-91ce-c2a0726b50ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1370146724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0417a0ce-38e4-4cdf-b7cd-37bfe51a30b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05ad70ac35f54361b5c2ae5498d7ee27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:15:41Z,use_quota=True,user_id='2733cf6c08544a41b0412e82b6a1a218',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-699b61cd-d0ef-438d-9641-2ef85e0856a9 tempest-VolumesListAdminTestJSON-2014480160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9db03ec3-ab53-4bd0-ad1b-1f194f57d90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-699b61cd-d0ef-438d-9641-2ef85e0856a9 tempest-VolumesListAdminTestJSON-2014480160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9db03ec3-ab53-4bd0-ad1b-1f194f57d90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-699b61cd-d0ef-438d-9641-2ef85e0856a9 tempest-VolumesListAdminTestJSON-2014480160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54ce38ef-b7aa-4559-96af-c0f5fc427486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-699b61cd-d0ef-438d-9641-2ef85e0856a9 tempest-VolumesListAdminTestJSON-2014480160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54ce38ef-b7aa-4559-96af-c0f5fc427486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0417a0ce-38e4-4cdf-b7cd-37bfe51a30b6', 'volume_name': 'volume-0417a0ce-38e4-4cdf-b7cd-37bfe51a30b6', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-699b61cd-d0ef-438d-9641-2ef85e0856a9 tempest-VolumesListAdminTestJSON-2014480160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (517cf4da-e3e5-4e93-b4a3-b2254ab3fc66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-699b61cd-d0ef-438d-9641-2ef85e0856a9 tempest-VolumesListAdminTestJSON-2014480160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (517cf4da-e3e5-4e93-b4a3-b2254ab3fc66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-699b61cd-d0ef-438d-9641-2ef85e0856a9 tempest-VolumesListAdminTestJSON-2014480160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39613d56-5633-4324-8e0c-2b5cb486e464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:41 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-699b61cd-d0ef-438d-9641-2ef85e0856a9 tempest-VolumesListAdminTestJSON-2014480160 None] Volume 0417a0ce-38e4-4cdf-b7cd-37bfe51a30b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0417a0ce-38e4-4cdf-b7cd-37bfe51a30b6', 'volume_size': 1} Apr 28 19:15:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-699b61cd-d0ef-438d-9641-2ef85e0856a9 tempest-VolumesListAdminTestJSON-2014480160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:15:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-16a81449-2c08-4b0e-8371-68e610fd3c50 tempest-VolumesTestJSON-2089928167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47b24a5b-9ce1-45fd-b66b-8a88dafe1e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45026d2c-f497-403b-b357-0370acf3b884', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-16a81449-2c08-4b0e-8371-68e610fd3c50 tempest-VolumesTestJSON-2089928167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a132237-dcd2-49e2-b9a3-97c3f87248ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:41 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-16a81449-2c08-4b0e-8371-68e610fd3c50 tempest-VolumesTestJSON-2089928167 None] Volume volume-45026d2c-f497-403b-b357-0370acf3b884 (45026d2c-f497-403b-b357-0370acf3b884): created successfully Apr 28 19:15:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-16a81449-2c08-4b0e-8371-68e610fd3c50 tempest-VolumesTestJSON-2089928167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a132237-dcd2-49e2-b9a3-97c3f87248ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-16a81449-2c08-4b0e-8371-68e610fd3c50 tempest-VolumesTestJSON-2089928167 None] Flow 'volume_create_manager' (a8737cd4-2297-497d-8997-01e4b82de03f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:15:41 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-16a81449-2c08-4b0e-8371-68e610fd3c50 tempest-VolumesTestJSON-2089928167 None] Created volume successfully. Apr 28 19:15:41 devstack sudo[86188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5e50ff44-c79c-43b1-955d-fc92f513c0f5 Apr 28 19:15:41 devstack sudo[86188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:41 devstack sudo[86188]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-45c15bad-e30a-4ee1-ae95-69e68bb85389 req-83ea714e-0819-42f5-bf16-a7ec28c088ec tempest-DeleteServersTestJSON-1034568749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5e50ff44-c79c-43b1-955d-fc92f513c0f5" returned: 0 in 0.812s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-45c15bad-e30a-4ee1-ae95-69e68bb85389 req-83ea714e-0819-42f5-bf16-a7ec28c088ec tempest-DeleteServersTestJSON-1034568749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.869s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:15:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-699b61cd-d0ef-438d-9641-2ef85e0856a9 tempest-VolumesListAdminTestJSON-2014480160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.743s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:15:41 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-699b61cd-d0ef-438d-9641-2ef85e0856a9 tempest-VolumesListAdminTestJSON-2014480160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1370146724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0417a0ce-38e4-4cdf-b7cd-37bfe51a30b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05ad70ac35f54361b5c2ae5498d7ee27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:15:41Z,use_quota=True,user_id='2733cf6c08544a41b0412e82b6a1a218',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:15:41 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-699b61cd-d0ef-438d-9641-2ef85e0856a9 tempest-VolumesListAdminTestJSON-2014480160 None] Creating volume 0417a0ce-38e4-4cdf-b7cd-37bfe51a30b6 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:15:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-699b61cd-d0ef-438d-9641-2ef85e0856a9 tempest-VolumesListAdminTestJSON-2014480160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:15:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-699b61cd-d0ef-438d-9641-2ef85e0856a9 tempest-VolumesListAdminTestJSON-2014480160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:15:41 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-699b61cd-d0ef-438d-9641-2ef85e0856a9 tempest-VolumesListAdminTestJSON-2014480160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:15:41 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-699b61cd-d0ef-438d-9641-2ef85e0856a9 tempest-VolumesListAdminTestJSON-2014480160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:15:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-699b61cd-d0ef-438d-9641-2ef85e0856a9 tempest-VolumesListAdminTestJSON-2014480160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:15:41 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-699b61cd-d0ef-438d-9641-2ef85e0856a9 tempest-VolumesListAdminTestJSON-2014480160 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:15:41 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-699b61cd-d0ef-438d-9641-2ef85e0856a9 tempest-VolumesListAdminTestJSON-2014480160 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:15:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-699b61cd-d0ef-438d-9641-2ef85e0856a9 tempest-VolumesListAdminTestJSON-2014480160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-0417a0ce-38e4-4cdf-b7cd-37bfe51a30b6 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:42 devstack sudo[86193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-0417a0ce-38e4-4cdf-b7cd-37bfe51a30b6 1073741824 Apr 28 19:15:42 devstack sudo[86193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:42 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-45c15bad-e30a-4ee1-ae95-69e68bb85389 req-83ea714e-0819-42f5-bf16-a7ec28c088ec tempest-DeleteServersTestJSON-1034568749 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd', 'name': 'volume-5e50ff44-c79c-43b1-955d-fc92f513c0f5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ad56e0d4-bbaa-4da5-aee3-22e6e2fa2a6a', 'enforce_multipath': True} {{(pid=83863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 28 19:15:42 devstack cinder-volume[83863]: INFO cinder.volume.manager [req-45c15bad-e30a-4ee1-ae95-69e68bb85389 req-83ea714e-0819-42f5-bf16-a7ec28c088ec tempest-DeleteServersTestJSON-1034568749 None] attachment_update completed successfully. Apr 28 19:15:43 devstack sudo[86193]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-699b61cd-d0ef-438d-9641-2ef85e0856a9 tempest-VolumesListAdminTestJSON-2014480160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-0417a0ce-38e4-4cdf-b7cd-37bfe51a30b6 1073741824" returned: 0 in 1.218s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-699b61cd-d0ef-438d-9641-2ef85e0856a9 tempest-VolumesListAdminTestJSON-2014480160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-0417a0ce-38e4-4cdf-b7cd-37bfe51a30b6 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:43 devstack sudo[86267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-0417a0ce-38e4-4cdf-b7cd-37bfe51a30b6 Apr 28 19:15:43 devstack sudo[86267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:43 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-55280b67-4c72-4de1-a825-da072e45d109 tempest-VolumesTestJSON-2089928167 None] Acquiring lock "cinder-45026d2c-f497-403b-b357-0370acf3b884-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:15:43 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-55280b67-4c72-4de1-a825-da072e45d109 tempest-VolumesTestJSON-2089928167 None] Lock "cinder-45026d2c-f497-403b-b357-0370acf3b884-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:15:43 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-55280b67-4c72-4de1-a825-da072e45d109 tempest-VolumesTestJSON-2089928167 None] Acquiring lock "cinder-quobyte-45026d2c-f497-403b-b357-0370acf3b884" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:15:43 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-55280b67-4c72-4de1-a825-da072e45d109 tempest-VolumesTestJSON-2089928167 None] Lock "cinder-quobyte-45026d2c-f497-403b-b357-0370acf3b884" acquired by "delete_volume" :: waited 0.019s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:15:43 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9304f093-2f36-4b20-83bd-1145544a8790]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:15:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-55280b67-4c72-4de1-a825-da072e45d109 tempest-VolumesTestJSON-2089928167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-45026d2c-f497-403b-b357-0370acf3b884 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:43 devstack sudo[86479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-45026d2c-f497-403b-b357-0370acf3b884 Apr 28 19:15:43 devstack sudo[86479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:44 devstack sudo[86267]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-699b61cd-d0ef-438d-9641-2ef85e0856a9 tempest-VolumesListAdminTestJSON-2014480160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-0417a0ce-38e4-4cdf-b7cd-37bfe51a30b6" returned: 0 in 0.783s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:44 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-699b61cd-d0ef-438d-9641-2ef85e0856a9 tempest-VolumesListAdminTestJSON-2014480160 None] <== create_volume: return (2055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:15:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-699b61cd-d0ef-438d-9641-2ef85e0856a9 tempest-VolumesListAdminTestJSON-2014480160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.058s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:15:44 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-699b61cd-d0ef-438d-9641-2ef85e0856a9 tempest-VolumesListAdminTestJSON-2014480160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39613d56-5633-4324-8e0c-2b5cb486e464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0417a0ce-38e4-4cdf-b7cd-37bfe51a30b6', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:44 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-699b61cd-d0ef-438d-9641-2ef85e0856a9 tempest-VolumesListAdminTestJSON-2014480160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ba60b8d-9a75-4aad-a0be-4ae4a1cf1690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:44 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-699b61cd-d0ef-438d-9641-2ef85e0856a9 tempest-VolumesListAdminTestJSON-2014480160 None] Volume volume-0417a0ce-38e4-4cdf-b7cd-37bfe51a30b6 (0417a0ce-38e4-4cdf-b7cd-37bfe51a30b6): created successfully Apr 28 19:15:44 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-699b61cd-d0ef-438d-9641-2ef85e0856a9 tempest-VolumesListAdminTestJSON-2014480160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ba60b8d-9a75-4aad-a0be-4ae4a1cf1690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:44 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-699b61cd-d0ef-438d-9641-2ef85e0856a9 tempest-VolumesListAdminTestJSON-2014480160 None] Flow 'volume_create_manager' (f62752b5-2431-4005-b45d-1cb5bbe47c0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:15:44 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-699b61cd-d0ef-438d-9641-2ef85e0856a9 tempest-VolumesListAdminTestJSON-2014480160 None] Created volume successfully. Apr 28 19:15:44 devstack sudo[86479]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-55280b67-4c72-4de1-a825-da072e45d109 tempest-VolumesTestJSON-2089928167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-45026d2c-f497-403b-b357-0370acf3b884" returned: 0 in 0.802s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-55280b67-4c72-4de1-a825-da072e45d109 tempest-VolumesTestJSON-2089928167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-45026d2c-f497-403b-b357-0370acf3b884 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:44 devstack sudo[86591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-45026d2c-f497-403b-b357-0370acf3b884 Apr 28 19:15:44 devstack sudo[86591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:44 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-a108af74-e21c-43d4-8e11-2fab89a8296a tempest-GroupsTest-1298413161 None] Group tempest-Group1-267170698: creating Apr 28 19:15:44 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-a108af74-e21c-43d4-8e11-2fab89a8296a tempest-GroupsTest-1298413161 None] Group tempest-Group1-267170698: created successfully Apr 28 19:15:44 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-a108af74-e21c-43d4-8e11-2fab89a8296a tempest-GroupsTest-1298413161 None] Create group completed successfully. Apr 28 19:15:44 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-70dd4557-91f5-41b9-9670-5037fe3f0d7b tempest-VolumesListAdminTestJSON-2014480160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:15:44 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-70dd4557-91f5-41b9-9670-5037fe3f0d7b tempest-VolumesListAdminTestJSON-2014480160 None] Flow 'volume_create_manager' (5b9bc91e-07a1-45ef-965f-af6cf7b823fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:15:44 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-70dd4557-91f5-41b9-9670-5037fe3f0d7b tempest-VolumesListAdminTestJSON-2014480160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a743610c-df24-4433-a601-ffc394094b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:44 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-70dd4557-91f5-41b9-9670-5037fe3f0d7b tempest-VolumesListAdminTestJSON-2014480160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a743610c-df24-4433-a601-ffc394094b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-487900767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7526626f-5011-4e33-823e-4a4342ed6f0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05ad70ac35f54361b5c2ae5498d7ee27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:15:45Z,use_quota=True,user_id='2733cf6c08544a41b0412e82b6a1a218',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:44 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-70dd4557-91f5-41b9-9670-5037fe3f0d7b tempest-VolumesListAdminTestJSON-2014480160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc5e1b67-543c-4d23-b74b-114f86f2e14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:44 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-70dd4557-91f5-41b9-9670-5037fe3f0d7b tempest-VolumesListAdminTestJSON-2014480160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc5e1b67-543c-4d23-b74b-114f86f2e14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:44 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-70dd4557-91f5-41b9-9670-5037fe3f0d7b tempest-VolumesListAdminTestJSON-2014480160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88eb7382-3cf3-43a6-8a93-a9e961fbd5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:44 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-70dd4557-91f5-41b9-9670-5037fe3f0d7b tempest-VolumesListAdminTestJSON-2014480160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88eb7382-3cf3-43a6-8a93-a9e961fbd5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7526626f-5011-4e33-823e-4a4342ed6f0c', 'volume_name': 'volume-7526626f-5011-4e33-823e-4a4342ed6f0c', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:44 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-70dd4557-91f5-41b9-9670-5037fe3f0d7b tempest-VolumesListAdminTestJSON-2014480160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb12439b-2920-4796-b0d7-16221e1617ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:44 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-70dd4557-91f5-41b9-9670-5037fe3f0d7b tempest-VolumesListAdminTestJSON-2014480160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb12439b-2920-4796-b0d7-16221e1617ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:44 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-70dd4557-91f5-41b9-9670-5037fe3f0d7b tempest-VolumesListAdminTestJSON-2014480160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8c014df-23b0-457c-a919-e2f434cead15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:44 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-70dd4557-91f5-41b9-9670-5037fe3f0d7b tempest-VolumesListAdminTestJSON-2014480160 None] Volume 7526626f-5011-4e33-823e-4a4342ed6f0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7526626f-5011-4e33-823e-4a4342ed6f0c', 'volume_size': 1} Apr 28 19:15:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-70dd4557-91f5-41b9-9670-5037fe3f0d7b tempest-VolumesListAdminTestJSON-2014480160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:15:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-70dd4557-91f5-41b9-9670-5037fe3f0d7b tempest-VolumesListAdminTestJSON-2014480160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:15:44 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-70dd4557-91f5-41b9-9670-5037fe3f0d7b tempest-VolumesListAdminTestJSON-2014480160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-487900767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7526626f-5011-4e33-823e-4a4342ed6f0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05ad70ac35f54361b5c2ae5498d7ee27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:15:45Z,use_quota=True,user_id='2733cf6c08544a41b0412e82b6a1a218',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:15:44 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-70dd4557-91f5-41b9-9670-5037fe3f0d7b tempest-VolumesListAdminTestJSON-2014480160 None] Creating volume 7526626f-5011-4e33-823e-4a4342ed6f0c {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:15:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-70dd4557-91f5-41b9-9670-5037fe3f0d7b tempest-VolumesListAdminTestJSON-2014480160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:15:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-70dd4557-91f5-41b9-9670-5037fe3f0d7b tempest-VolumesListAdminTestJSON-2014480160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:15:44 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-70dd4557-91f5-41b9-9670-5037fe3f0d7b tempest-VolumesListAdminTestJSON-2014480160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:15:44 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-70dd4557-91f5-41b9-9670-5037fe3f0d7b tempest-VolumesListAdminTestJSON-2014480160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:15:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-70dd4557-91f5-41b9-9670-5037fe3f0d7b tempest-VolumesListAdminTestJSON-2014480160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:15:44 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-70dd4557-91f5-41b9-9670-5037fe3f0d7b tempest-VolumesListAdminTestJSON-2014480160 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:15:44 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-70dd4557-91f5-41b9-9670-5037fe3f0d7b tempest-VolumesListAdminTestJSON-2014480160 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:15:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-70dd4557-91f5-41b9-9670-5037fe3f0d7b tempest-VolumesListAdminTestJSON-2014480160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7526626f-5011-4e33-823e-4a4342ed6f0c 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:44 devstack sudo[86594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7526626f-5011-4e33-823e-4a4342ed6f0c 1073741824 Apr 28 19:15:44 devstack sudo[86594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:44 devstack sudo[86591]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-55280b67-4c72-4de1-a825-da072e45d109 tempest-VolumesTestJSON-2089928167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-45026d2c-f497-403b-b357-0370acf3b884" returned: 0 in 0.636s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:44 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-55280b67-4c72-4de1-a825-da072e45d109 tempest-VolumesTestJSON-2089928167 None] Lock "cinder-quobyte-45026d2c-f497-403b-b357-0370acf3b884" released by "delete_volume" :: held 1.491s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:15:45 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-55280b67-4c72-4de1-a825-da072e45d109 tempest-VolumesTestJSON-2089928167 None] Created reservations ['573ffba9-ec71-46d5-962d-4330992200db', 'c88c354c-59f7-4447-a624-b9a0de4e034d', 'dffa7cb6-e2aa-450c-874d-3724e9421487', '37dfd8f8-c258-4289-acd9-78f0e2a47611'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:15:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-55280b67-4c72-4de1-a825-da072e45d109 tempest-VolumesTestJSON-2089928167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:15:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-55280b67-4c72-4de1-a825-da072e45d109 tempest-VolumesTestJSON-2089928167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:15:45 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-55280b67-4c72-4de1-a825-da072e45d109 tempest-VolumesTestJSON-2089928167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:15:45 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-55280b67-4c72-4de1-a825-da072e45d109 tempest-VolumesTestJSON-2089928167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:15:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-55280b67-4c72-4de1-a825-da072e45d109 tempest-VolumesTestJSON-2089928167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:15:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-55280b67-4c72-4de1-a825-da072e45d109 tempest-VolumesTestJSON-2089928167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:45 devstack sudo[86599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:15:45 devstack sudo[86599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:45 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ef4c624a-3385-4688-b29a-7f9c1cdb9e83 tempest-VolumesTestJSON-2089928167 None] Acquiring lock "cinder-ed89f4a6-d754-499b-b4e9-638229f9356c-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:15:45 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-cf0ac8db-e4d1-4f53-a8d6-37bb11aee228 tempest-GroupsTest-1298413161 None] Group tempest-Group2-301182915: creating Apr 28 19:15:45 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ef4c624a-3385-4688-b29a-7f9c1cdb9e83 tempest-VolumesTestJSON-2089928167 None] Lock "cinder-ed89f4a6-d754-499b-b4e9-638229f9356c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:15:45 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ef4c624a-3385-4688-b29a-7f9c1cdb9e83 tempest-VolumesTestJSON-2089928167 None] Acquiring lock "cinder-quobyte-ed89f4a6-d754-499b-b4e9-638229f9356c" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:15:45 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-cf0ac8db-e4d1-4f53-a8d6-37bb11aee228 tempest-GroupsTest-1298413161 None] Group tempest-Group2-301182915: created successfully Apr 28 19:15:45 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-cf0ac8db-e4d1-4f53-a8d6-37bb11aee228 tempest-GroupsTest-1298413161 None] Create group completed successfully. Apr 28 19:15:45 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ef4c624a-3385-4688-b29a-7f9c1cdb9e83 tempest-VolumesTestJSON-2089928167 None] Lock "cinder-quobyte-ed89f4a6-d754-499b-b4e9-638229f9356c" acquired by "delete_volume" :: waited 0.042s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:15:45 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0323c9ef-8b8c-405c-a9b1-f0dbfe5aab16]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:15:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ef4c624a-3385-4688-b29a-7f9c1cdb9e83 tempest-VolumesTestJSON-2089928167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ed89f4a6-d754-499b-b4e9-638229f9356c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:45 devstack sudo[86599]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-55280b67-4c72-4de1-a825-da072e45d109 tempest-VolumesTestJSON-2089928167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.744s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:45 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-55280b67-4c72-4de1-a825-da072e45d109 tempest-VolumesTestJSON-2089928167 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:15:45 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-55280b67-4c72-4de1-a825-da072e45d109 tempest-VolumesTestJSON-2089928167 None] Deleted volume successfully. Apr 28 19:15:45 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-55280b67-4c72-4de1-a825-da072e45d109 tempest-VolumesTestJSON-2089928167 None] Lock "cinder-45026d2c-f497-403b-b357-0370acf3b884-delete_volume" released by "delete_volume" :: held 2.455s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:15:45 devstack sudo[86594]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-70dd4557-91f5-41b9-9670-5037fe3f0d7b tempest-VolumesListAdminTestJSON-2014480160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7526626f-5011-4e33-823e-4a4342ed6f0c 1073741824" returned: 0 in 0.999s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-70dd4557-91f5-41b9-9670-5037fe3f0d7b tempest-VolumesListAdminTestJSON-2014480160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7526626f-5011-4e33-823e-4a4342ed6f0c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:45 devstack sudo[86609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ed89f4a6-d754-499b-b4e9-638229f9356c Apr 28 19:15:45 devstack sudo[86609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:45 devstack sudo[86610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7526626f-5011-4e33-823e-4a4342ed6f0c Apr 28 19:15:45 devstack sudo[86610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:46 devstack sudo[86610]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-70dd4557-91f5-41b9-9670-5037fe3f0d7b tempest-VolumesListAdminTestJSON-2014480160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7526626f-5011-4e33-823e-4a4342ed6f0c" returned: 0 in 0.616s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:46 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-70dd4557-91f5-41b9-9670-5037fe3f0d7b tempest-VolumesListAdminTestJSON-2014480160 None] <== create_volume: return (1653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:15:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-70dd4557-91f5-41b9-9670-5037fe3f0d7b tempest-VolumesListAdminTestJSON-2014480160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.656s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:15:46 devstack sudo[86609]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:46 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-70dd4557-91f5-41b9-9670-5037fe3f0d7b tempest-VolumesListAdminTestJSON-2014480160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8c014df-23b0-457c-a919-e2f434cead15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7526626f-5011-4e33-823e-4a4342ed6f0c', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:46 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-70dd4557-91f5-41b9-9670-5037fe3f0d7b tempest-VolumesListAdminTestJSON-2014480160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab331ce8-a291-41ab-91a5-640269da7df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ef4c624a-3385-4688-b29a-7f9c1cdb9e83 tempest-VolumesTestJSON-2089928167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ed89f4a6-d754-499b-b4e9-638229f9356c" returned: 0 in 0.755s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ef4c624a-3385-4688-b29a-7f9c1cdb9e83 tempest-VolumesTestJSON-2089928167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ed89f4a6-d754-499b-b4e9-638229f9356c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:46 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-70dd4557-91f5-41b9-9670-5037fe3f0d7b tempest-VolumesListAdminTestJSON-2014480160 None] Volume volume-7526626f-5011-4e33-823e-4a4342ed6f0c (7526626f-5011-4e33-823e-4a4342ed6f0c): created successfully Apr 28 19:15:46 devstack sudo[86617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ed89f4a6-d754-499b-b4e9-638229f9356c Apr 28 19:15:46 devstack sudo[86617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:46 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-70dd4557-91f5-41b9-9670-5037fe3f0d7b tempest-VolumesListAdminTestJSON-2014480160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab331ce8-a291-41ab-91a5-640269da7df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:46 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-70dd4557-91f5-41b9-9670-5037fe3f0d7b tempest-VolumesListAdminTestJSON-2014480160 None] Flow 'volume_create_manager' (5b9bc91e-07a1-45ef-965f-af6cf7b823fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:15:46 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-70dd4557-91f5-41b9-9670-5037fe3f0d7b tempest-VolumesListAdminTestJSON-2014480160 None] Created volume successfully. Apr 28 19:15:47 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-823bf19a-ce7e-48a9-9cdc-edcabdfeb8d6 tempest-GroupsTest-1298413161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:15:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-823bf19a-ce7e-48a9-9cdc-edcabdfeb8d6 tempest-GroupsTest-1298413161 None] Flow 'volume_create_manager' (63787671-7e09-4a46-a258-f96f6713d31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:15:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-823bf19a-ce7e-48a9-9cdc-edcabdfeb8d6 tempest-GroupsTest-1298413161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28b757c9-a86f-4524-867f-cbca3fe4291a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-823bf19a-ce7e-48a9-9cdc-edcabdfeb8d6 tempest-GroupsTest-1298413161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28b757c9-a86f-4524-867f-cbca3fe4291a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:15:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1058193924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=451ca046-4fc7-4afe-9580-74efeb211b3f,host='devstack@QuobyteHD#QuobyteHD',id=981c4375-0d2f-4b77-be78-5826545b3fe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5607497568e740c7b48174c0deeb6b6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:15:47Z,use_quota=True,user_id='b880827c6a40403eb485d80ff072a698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2a52ddb-e215-4d24-863f-c27dedadce3e),volume_type_id=f2a52ddb-e215-4d24-863f-c27dedadce3e)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-823bf19a-ce7e-48a9-9cdc-edcabdfeb8d6 tempest-GroupsTest-1298413161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (137e72bf-4d6a-4b07-9d0c-5683009f95dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-823bf19a-ce7e-48a9-9cdc-edcabdfeb8d6 tempest-GroupsTest-1298413161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (137e72bf-4d6a-4b07-9d0c-5683009f95dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-823bf19a-ce7e-48a9-9cdc-edcabdfeb8d6 tempest-GroupsTest-1298413161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c474ce8-b0ec-4099-8b9c-e32c12743508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-823bf19a-ce7e-48a9-9cdc-edcabdfeb8d6 tempest-GroupsTest-1298413161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c474ce8-b0ec-4099-8b9c-e32c12743508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '981c4375-0d2f-4b77-be78-5826545b3fe0', 'volume_name': 'volume-981c4375-0d2f-4b77-be78-5826545b3fe0', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-823bf19a-ce7e-48a9-9cdc-edcabdfeb8d6 tempest-GroupsTest-1298413161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5633153c-59e9-4a97-9b95-f753504519b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-823bf19a-ce7e-48a9-9cdc-edcabdfeb8d6 tempest-GroupsTest-1298413161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5633153c-59e9-4a97-9b95-f753504519b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-823bf19a-ce7e-48a9-9cdc-edcabdfeb8d6 tempest-GroupsTest-1298413161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72558712-bbfb-4045-a0d6-f817ee020ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:47 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-823bf19a-ce7e-48a9-9cdc-edcabdfeb8d6 tempest-GroupsTest-1298413161 None] Volume 981c4375-0d2f-4b77-be78-5826545b3fe0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-981c4375-0d2f-4b77-be78-5826545b3fe0', 'volume_size': 1} Apr 28 19:15:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-823bf19a-ce7e-48a9-9cdc-edcabdfeb8d6 tempest-GroupsTest-1298413161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:15:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-823bf19a-ce7e-48a9-9cdc-edcabdfeb8d6 tempest-GroupsTest-1298413161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:15:47 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-823bf19a-ce7e-48a9-9cdc-edcabdfeb8d6 tempest-GroupsTest-1298413161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=451ca046-4fc7-4afe-9580-74efeb211b3f,created_at=2026-04-28T17:15:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1058193924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=451ca046-4fc7-4afe-9580-74efeb211b3f,host='devstack@QuobyteHD#QuobyteHD',id=981c4375-0d2f-4b77-be78-5826545b3fe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5607497568e740c7b48174c0deeb6b6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:15:47Z,use_quota=True,user_id='b880827c6a40403eb485d80ff072a698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2a52ddb-e215-4d24-863f-c27dedadce3e),volume_type_id=f2a52ddb-e215-4d24-863f-c27dedadce3e)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:15:47 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-823bf19a-ce7e-48a9-9cdc-edcabdfeb8d6 tempest-GroupsTest-1298413161 None] Creating volume 981c4375-0d2f-4b77-be78-5826545b3fe0 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:15:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-823bf19a-ce7e-48a9-9cdc-edcabdfeb8d6 tempest-GroupsTest-1298413161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:15:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-823bf19a-ce7e-48a9-9cdc-edcabdfeb8d6 tempest-GroupsTest-1298413161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:15:47 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-823bf19a-ce7e-48a9-9cdc-edcabdfeb8d6 tempest-GroupsTest-1298413161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:15:47 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-823bf19a-ce7e-48a9-9cdc-edcabdfeb8d6 tempest-GroupsTest-1298413161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:15:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-823bf19a-ce7e-48a9-9cdc-edcabdfeb8d6 tempest-GroupsTest-1298413161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:15:47 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-823bf19a-ce7e-48a9-9cdc-edcabdfeb8d6 tempest-GroupsTest-1298413161 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:15:47 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-823bf19a-ce7e-48a9-9cdc-edcabdfeb8d6 tempest-GroupsTest-1298413161 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:15:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-823bf19a-ce7e-48a9-9cdc-edcabdfeb8d6 tempest-GroupsTest-1298413161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-981c4375-0d2f-4b77-be78-5826545b3fe0 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:47 devstack sudo[86622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-981c4375-0d2f-4b77-be78-5826545b3fe0 1073741824 Apr 28 19:15:47 devstack sudo[86622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:47 devstack sudo[86617]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ef4c624a-3385-4688-b29a-7f9c1cdb9e83 tempest-VolumesTestJSON-2089928167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ed89f4a6-d754-499b-b4e9-638229f9356c" returned: 0 in 0.855s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ef4c624a-3385-4688-b29a-7f9c1cdb9e83 tempest-VolumesTestJSON-2089928167 None] Lock "cinder-quobyte-ed89f4a6-d754-499b-b4e9-638229f9356c" released by "delete_volume" :: held 1.687s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:15:47 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-ef4c624a-3385-4688-b29a-7f9c1cdb9e83 tempest-VolumesTestJSON-2089928167 None] Created reservations ['6b5705c1-6a5c-46c1-a5f5-dba9505a4b4b', '63e6ae0e-61c5-427a-a76e-fee10daf19f7', '69be0db6-b418-4107-b389-3f1d5b5c5bfc', '21fdb3af-0651-49c4-816d-cfc9b196d8e0'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:15:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ef4c624a-3385-4688-b29a-7f9c1cdb9e83 tempest-VolumesTestJSON-2089928167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:15:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ef4c624a-3385-4688-b29a-7f9c1cdb9e83 tempest-VolumesTestJSON-2089928167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:15:47 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ef4c624a-3385-4688-b29a-7f9c1cdb9e83 tempest-VolumesTestJSON-2089928167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:15:47 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ef4c624a-3385-4688-b29a-7f9c1cdb9e83 tempest-VolumesTestJSON-2089928167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:15:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ef4c624a-3385-4688-b29a-7f9c1cdb9e83 tempest-VolumesTestJSON-2089928167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:15:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ef4c624a-3385-4688-b29a-7f9c1cdb9e83 tempest-VolumesTestJSON-2089928167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:47 devstack sudo[86624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:15:47 devstack sudo[86624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:47 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-dccf048f-a2e9-49fa-b4d3-878913f72d1e tempest-VolumesListAdminTestJSON-1716529319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:15:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-dccf048f-a2e9-49fa-b4d3-878913f72d1e tempest-VolumesListAdminTestJSON-1716529319 None] Flow 'volume_create_manager' (a21a493a-7c93-4560-a6a0-7a64f60f17db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:15:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-dccf048f-a2e9-49fa-b4d3-878913f72d1e tempest-VolumesListAdminTestJSON-1716529319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28c6966a-8055-4d24-9b80-9509831c1994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-dccf048f-a2e9-49fa-b4d3-878913f72d1e tempest-VolumesListAdminTestJSON-1716529319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28c6966a-8055-4d24-9b80-9509831c1994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ed9f35d-662e-4ccf-b596-593439418bc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd529ad6335949779190399abb03248d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:15:48Z,use_quota=True,user_id='8058deca723a4d6a9faf818052fa6841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-dccf048f-a2e9-49fa-b4d3-878913f72d1e tempest-VolumesListAdminTestJSON-1716529319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (008d705a-54d1-426a-81d6-07d1642a1e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-dccf048f-a2e9-49fa-b4d3-878913f72d1e tempest-VolumesListAdminTestJSON-1716529319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (008d705a-54d1-426a-81d6-07d1642a1e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-dccf048f-a2e9-49fa-b4d3-878913f72d1e tempest-VolumesListAdminTestJSON-1716529319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc5d8cad-178b-4366-8b50-7b1c518afc34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-dccf048f-a2e9-49fa-b4d3-878913f72d1e tempest-VolumesListAdminTestJSON-1716529319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc5d8cad-178b-4366-8b50-7b1c518afc34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ed9f35d-662e-4ccf-b596-593439418bc3', 'volume_name': 'volume-5ed9f35d-662e-4ccf-b596-593439418bc3', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-dccf048f-a2e9-49fa-b4d3-878913f72d1e tempest-VolumesListAdminTestJSON-1716529319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf479a99-27cb-46f7-81e0-be8ce3f0bca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-dccf048f-a2e9-49fa-b4d3-878913f72d1e tempest-VolumesListAdminTestJSON-1716529319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf479a99-27cb-46f7-81e0-be8ce3f0bca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-dccf048f-a2e9-49fa-b4d3-878913f72d1e tempest-VolumesListAdminTestJSON-1716529319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e12c394e-bd81-4b45-9fcf-dc215c1a1353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:47 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-dccf048f-a2e9-49fa-b4d3-878913f72d1e tempest-VolumesListAdminTestJSON-1716529319 None] Volume 5ed9f35d-662e-4ccf-b596-593439418bc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ed9f35d-662e-4ccf-b596-593439418bc3', 'volume_size': 1} Apr 28 19:15:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-dccf048f-a2e9-49fa-b4d3-878913f72d1e tempest-VolumesListAdminTestJSON-1716529319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:15:48 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-045e239e-19df-4ffb-8aa6-0e8ff6115f60 tempest-VolumesTestJSON-2089928167 None] Acquiring lock "cinder-f75ff9c6-f811-4ca4-8c53-e585047973ae-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:15:48 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-045e239e-19df-4ffb-8aa6-0e8ff6115f60 tempest-VolumesTestJSON-2089928167 None] Lock "cinder-f75ff9c6-f811-4ca4-8c53-e585047973ae-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:15:48 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-045e239e-19df-4ffb-8aa6-0e8ff6115f60 tempest-VolumesTestJSON-2089928167 None] Acquiring lock "cinder-quobyte-f75ff9c6-f811-4ca4-8c53-e585047973ae" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:15:48 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-045e239e-19df-4ffb-8aa6-0e8ff6115f60 tempest-VolumesTestJSON-2089928167 None] Lock "cinder-quobyte-f75ff9c6-f811-4ca4-8c53-e585047973ae" acquired by "delete_volume" :: waited 0.029s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:15:48 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c066a89f-929a-407b-b4aa-2eb6d896137c]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:15:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-045e239e-19df-4ffb-8aa6-0e8ff6115f60 tempest-VolumesTestJSON-2089928167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f75ff9c6-f811-4ca4-8c53-e585047973ae {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:48 devstack sudo[86668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f75ff9c6-f811-4ca4-8c53-e585047973ae Apr 28 19:15:48 devstack sudo[86668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:48 devstack sudo[86624]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ef4c624a-3385-4688-b29a-7f9c1cdb9e83 tempest-VolumesTestJSON-2089928167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 1.007s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:48 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-ef4c624a-3385-4688-b29a-7f9c1cdb9e83 tempest-VolumesTestJSON-2089928167 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:15:48 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-ef4c624a-3385-4688-b29a-7f9c1cdb9e83 tempest-VolumesTestJSON-2089928167 None] Deleted volume successfully. Apr 28 19:15:48 devstack sudo[86622]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:48 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ef4c624a-3385-4688-b29a-7f9c1cdb9e83 tempest-VolumesTestJSON-2089928167 None] Lock "cinder-ed89f4a6-d754-499b-b4e9-638229f9356c-delete_volume" released by "delete_volume" :: held 2.955s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:15:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-823bf19a-ce7e-48a9-9cdc-edcabdfeb8d6 tempest-GroupsTest-1298413161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-981c4375-0d2f-4b77-be78-5826545b3fe0 1073741824" returned: 0 in 1.257s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-823bf19a-ce7e-48a9-9cdc-edcabdfeb8d6 tempest-GroupsTest-1298413161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-981c4375-0d2f-4b77-be78-5826545b3fe0 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:48 devstack sudo[86674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-981c4375-0d2f-4b77-be78-5826545b3fe0 Apr 28 19:15:48 devstack sudo[86674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:49 devstack sudo[86668]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-045e239e-19df-4ffb-8aa6-0e8ff6115f60 tempest-VolumesTestJSON-2089928167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f75ff9c6-f811-4ca4-8c53-e585047973ae" returned: 0 in 0.948s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-045e239e-19df-4ffb-8aa6-0e8ff6115f60 tempest-VolumesTestJSON-2089928167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f75ff9c6-f811-4ca4-8c53-e585047973ae {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:49 devstack sudo[86705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f75ff9c6-f811-4ca4-8c53-e585047973ae Apr 28 19:15:49 devstack sudo[86705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:49 devstack sudo[86674]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-823bf19a-ce7e-48a9-9cdc-edcabdfeb8d6 tempest-GroupsTest-1298413161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-981c4375-0d2f-4b77-be78-5826545b3fe0" returned: 0 in 0.770s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:49 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-823bf19a-ce7e-48a9-9cdc-edcabdfeb8d6 tempest-GroupsTest-1298413161 None] <== create_volume: return (2080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:15:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-823bf19a-ce7e-48a9-9cdc-edcabdfeb8d6 tempest-GroupsTest-1298413161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.083s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:15:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-dccf048f-a2e9-49fa-b4d3-878913f72d1e tempest-VolumesListAdminTestJSON-1716529319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.504s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:15:49 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-dccf048f-a2e9-49fa-b4d3-878913f72d1e tempest-VolumesListAdminTestJSON-1716529319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ed9f35d-662e-4ccf-b596-593439418bc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd529ad6335949779190399abb03248d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:15:48Z,use_quota=True,user_id='8058deca723a4d6a9faf818052fa6841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:15:49 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-dccf048f-a2e9-49fa-b4d3-878913f72d1e tempest-VolumesListAdminTestJSON-1716529319 None] Creating volume 5ed9f35d-662e-4ccf-b596-593439418bc3 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:15:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-dccf048f-a2e9-49fa-b4d3-878913f72d1e tempest-VolumesListAdminTestJSON-1716529319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:15:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-dccf048f-a2e9-49fa-b4d3-878913f72d1e tempest-VolumesListAdminTestJSON-1716529319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:15:49 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-dccf048f-a2e9-49fa-b4d3-878913f72d1e tempest-VolumesListAdminTestJSON-1716529319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:15:49 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-dccf048f-a2e9-49fa-b4d3-878913f72d1e tempest-VolumesListAdminTestJSON-1716529319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:15:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-dccf048f-a2e9-49fa-b4d3-878913f72d1e tempest-VolumesListAdminTestJSON-1716529319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:15:49 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-dccf048f-a2e9-49fa-b4d3-878913f72d1e tempest-VolumesListAdminTestJSON-1716529319 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:15:49 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-dccf048f-a2e9-49fa-b4d3-878913f72d1e tempest-VolumesListAdminTestJSON-1716529319 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:15:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-dccf048f-a2e9-49fa-b4d3-878913f72d1e tempest-VolumesListAdminTestJSON-1716529319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5ed9f35d-662e-4ccf-b596-593439418bc3 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:49 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-823bf19a-ce7e-48a9-9cdc-edcabdfeb8d6 tempest-GroupsTest-1298413161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72558712-bbfb-4045-a0d6-f817ee020ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-981c4375-0d2f-4b77-be78-5826545b3fe0', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:49 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-823bf19a-ce7e-48a9-9cdc-edcabdfeb8d6 tempest-GroupsTest-1298413161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d389ae7-a15b-48c4-bd71-69db421ddf49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:49 devstack sudo[86709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5ed9f35d-662e-4ccf-b596-593439418bc3 1073741824 Apr 28 19:15:49 devstack sudo[86709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:49 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-823bf19a-ce7e-48a9-9cdc-edcabdfeb8d6 tempest-GroupsTest-1298413161 None] Volume volume-981c4375-0d2f-4b77-be78-5826545b3fe0 (981c4375-0d2f-4b77-be78-5826545b3fe0): created successfully Apr 28 19:15:49 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-823bf19a-ce7e-48a9-9cdc-edcabdfeb8d6 tempest-GroupsTest-1298413161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d389ae7-a15b-48c4-bd71-69db421ddf49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:49 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-823bf19a-ce7e-48a9-9cdc-edcabdfeb8d6 tempest-GroupsTest-1298413161 None] Flow 'volume_create_manager' (63787671-7e09-4a46-a258-f96f6713d31f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:15:49 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-823bf19a-ce7e-48a9-9cdc-edcabdfeb8d6 tempest-GroupsTest-1298413161 None] Created volume successfully. Apr 28 19:15:49 devstack sudo[86705]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-045e239e-19df-4ffb-8aa6-0e8ff6115f60 tempest-VolumesTestJSON-2089928167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f75ff9c6-f811-4ca4-8c53-e585047973ae" returned: 0 in 0.640s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:49 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-045e239e-19df-4ffb-8aa6-0e8ff6115f60 tempest-VolumesTestJSON-2089928167 None] Lock "cinder-quobyte-f75ff9c6-f811-4ca4-8c53-e585047973ae" released by "delete_volume" :: held 1.645s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:15:50 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-045e239e-19df-4ffb-8aa6-0e8ff6115f60 tempest-VolumesTestJSON-2089928167 None] Created reservations ['6b84ece7-ae7e-461a-8b37-26e818a47275', '86c1bb85-1299-4dbd-8d26-5e9950d4c10e', '8df56911-6245-470c-b861-05bc74ff3f90', 'd80f8997-b79a-4a71-b545-a3743d29054f'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:15:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-045e239e-19df-4ffb-8aa6-0e8ff6115f60 tempest-VolumesTestJSON-2089928167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:15:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-045e239e-19df-4ffb-8aa6-0e8ff6115f60 tempest-VolumesTestJSON-2089928167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:15:50 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-045e239e-19df-4ffb-8aa6-0e8ff6115f60 tempest-VolumesTestJSON-2089928167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:15:50 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-045e239e-19df-4ffb-8aa6-0e8ff6115f60 tempest-VolumesTestJSON-2089928167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:15:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-045e239e-19df-4ffb-8aa6-0e8ff6115f60 tempest-VolumesTestJSON-2089928167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:15:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-045e239e-19df-4ffb-8aa6-0e8ff6115f60 tempest-VolumesTestJSON-2089928167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:50 devstack sudo[86717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:15:50 devstack sudo[86717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:50 devstack sudo[86709]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-dccf048f-a2e9-49fa-b4d3-878913f72d1e tempest-VolumesListAdminTestJSON-1716529319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5ed9f35d-662e-4ccf-b596-593439418bc3 1073741824" returned: 0 in 0.876s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-dccf048f-a2e9-49fa-b4d3-878913f72d1e tempest-VolumesListAdminTestJSON-1716529319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5ed9f35d-662e-4ccf-b596-593439418bc3 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:50 devstack sudo[86720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5ed9f35d-662e-4ccf-b596-593439418bc3 Apr 28 19:15:50 devstack sudo[86720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:50 devstack sudo[86717]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-045e239e-19df-4ffb-8aa6-0e8ff6115f60 tempest-VolumesTestJSON-2089928167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.684s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:50 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-045e239e-19df-4ffb-8aa6-0e8ff6115f60 tempest-VolumesTestJSON-2089928167 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:15:50 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-045e239e-19df-4ffb-8aa6-0e8ff6115f60 tempest-VolumesTestJSON-2089928167 None] Deleted volume successfully. Apr 28 19:15:50 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-045e239e-19df-4ffb-8aa6-0e8ff6115f60 tempest-VolumesTestJSON-2089928167 None] Lock "cinder-f75ff9c6-f811-4ca4-8c53-e585047973ae-delete_volume" released by "delete_volume" :: held 2.736s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:15:51 devstack cinder-volume[83863]: INFO cinder.volume.manager [req-d0bb70aa-967d-4f8e-ad15-a63e48f51780 req-2d59492d-bed3-4a05-8c46-a42b59077345 tempest-DeleteServersTestJSON-1034568749 None] Terminate volume connection completed successfully. Apr 28 19:15:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-d0bb70aa-967d-4f8e-ad15-a63e48f51780 req-2d59492d-bed3-4a05-8c46-a42b59077345 tempest-DeleteServersTestJSON-1034568749 None] Deleting attachment ad56e0d4-bbaa-4da5-aee3-22e6e2fa2a6a. {{(pid=83863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 28 19:15:51 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-fba112fc-b6e0-40e5-9ddc-8075b89b33e1 tempest-GroupsTest-1298413161 None] Acquiring lock "cinder-quobyte-981c4375-0d2f-4b77-be78-5826545b3fe0" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:15:51 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-fba112fc-b6e0-40e5-9ddc-8075b89b33e1 tempest-GroupsTest-1298413161 None] Lock "cinder-quobyte-981c4375-0d2f-4b77-be78-5826545b3fe0" acquired by "delete_volume" :: waited 0.014s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:15:51 devstack sudo[86720]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:51 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e493f508-10cd-48f4-9654-5a0b5fbf916c]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:15:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fba112fc-b6e0-40e5-9ddc-8075b89b33e1 tempest-GroupsTest-1298413161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-981c4375-0d2f-4b77-be78-5826545b3fe0 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-dccf048f-a2e9-49fa-b4d3-878913f72d1e tempest-VolumesListAdminTestJSON-1716529319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5ed9f35d-662e-4ccf-b596-593439418bc3" returned: 0 in 0.861s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:51 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-dccf048f-a2e9-49fa-b4d3-878913f72d1e tempest-VolumesListAdminTestJSON-1716529319 None] <== create_volume: return (1792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:15:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-dccf048f-a2e9-49fa-b4d3-878913f72d1e tempest-VolumesListAdminTestJSON-1716529319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.798s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:15:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-dccf048f-a2e9-49fa-b4d3-878913f72d1e tempest-VolumesListAdminTestJSON-1716529319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e12c394e-bd81-4b45-9fcf-dc215c1a1353) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ed9f35d-662e-4ccf-b596-593439418bc3', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-dccf048f-a2e9-49fa-b4d3-878913f72d1e tempest-VolumesListAdminTestJSON-1716529319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2058706b-9c58-48be-a8ed-7d7dd7f67e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:51 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-dccf048f-a2e9-49fa-b4d3-878913f72d1e tempest-VolumesListAdminTestJSON-1716529319 None] Volume volume-5ed9f35d-662e-4ccf-b596-593439418bc3 (5ed9f35d-662e-4ccf-b596-593439418bc3): created successfully Apr 28 19:15:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-dccf048f-a2e9-49fa-b4d3-878913f72d1e tempest-VolumesListAdminTestJSON-1716529319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2058706b-9c58-48be-a8ed-7d7dd7f67e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-dccf048f-a2e9-49fa-b4d3-878913f72d1e tempest-VolumesListAdminTestJSON-1716529319 None] Flow 'volume_create_manager' (a21a493a-7c93-4560-a6a0-7a64f60f17db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:15:51 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-dccf048f-a2e9-49fa-b4d3-878913f72d1e tempest-VolumesListAdminTestJSON-1716529319 None] Created volume successfully. Apr 28 19:15:51 devstack sudo[86727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-981c4375-0d2f-4b77-be78-5826545b3fe0 Apr 28 19:15:51 devstack sudo[86727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:51 devstack sudo[86727]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fba112fc-b6e0-40e5-9ddc-8075b89b33e1 tempest-GroupsTest-1298413161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-981c4375-0d2f-4b77-be78-5826545b3fe0" returned: 0 in 0.754s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fba112fc-b6e0-40e5-9ddc-8075b89b33e1 tempest-GroupsTest-1298413161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-981c4375-0d2f-4b77-be78-5826545b3fe0 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:52 devstack sudo[86732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-981c4375-0d2f-4b77-be78-5826545b3fe0 Apr 28 19:15:52 devstack sudo[86732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3a652638-06a2-4402-b4c6-f2f7b1dcca5d tempest-VolumesListAdminTestJSON-1716529319 None] Acquiring lock "cinder-5ed9f35d-662e-4ccf-b596-593439418bc3-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:15:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3a652638-06a2-4402-b4c6-f2f7b1dcca5d tempest-VolumesListAdminTestJSON-1716529319 None] Lock "cinder-5ed9f35d-662e-4ccf-b596-593439418bc3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:15:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3a652638-06a2-4402-b4c6-f2f7b1dcca5d tempest-VolumesListAdminTestJSON-1716529319 None] Acquiring lock "cinder-quobyte-5ed9f35d-662e-4ccf-b596-593439418bc3" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:15:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3a652638-06a2-4402-b4c6-f2f7b1dcca5d tempest-VolumesListAdminTestJSON-1716529319 None] Lock "cinder-quobyte-5ed9f35d-662e-4ccf-b596-593439418bc3" acquired by "delete_volume" :: waited 0.025s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:15:52 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa4faa0-1531-443f-ad7c-844ed3b36bea]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:15:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3a652638-06a2-4402-b4c6-f2f7b1dcca5d tempest-VolumesListAdminTestJSON-1716529319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5ed9f35d-662e-4ccf-b596-593439418bc3 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-465b45fe-7b40-47a4-8503-cf90ccd3858a tempest-VolumesListAdminTestJSON-2014480160 None] Acquiring lock "cinder-7526626f-5011-4e33-823e-4a4342ed6f0c-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:15:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-465b45fe-7b40-47a4-8503-cf90ccd3858a tempest-VolumesListAdminTestJSON-2014480160 None] Lock "cinder-7526626f-5011-4e33-823e-4a4342ed6f0c-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:15:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-465b45fe-7b40-47a4-8503-cf90ccd3858a tempest-VolumesListAdminTestJSON-2014480160 None] Acquiring lock "cinder-quobyte-7526626f-5011-4e33-823e-4a4342ed6f0c" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:15:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-465b45fe-7b40-47a4-8503-cf90ccd3858a tempest-VolumesListAdminTestJSON-2014480160 None] Lock "cinder-quobyte-7526626f-5011-4e33-823e-4a4342ed6f0c" acquired by "delete_volume" :: waited 0.025s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:15:52 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e09055-06e7-4b81-89fd-629abd6084e1]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:15:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-465b45fe-7b40-47a4-8503-cf90ccd3858a tempest-VolumesListAdminTestJSON-2014480160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7526626f-5011-4e33-823e-4a4342ed6f0c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:52 devstack sudo[86732]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fba112fc-b6e0-40e5-9ddc-8075b89b33e1 tempest-GroupsTest-1298413161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-981c4375-0d2f-4b77-be78-5826545b3fe0" returned: 0 in 0.773s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:52 devstack sudo[86734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5ed9f35d-662e-4ccf-b596-593439418bc3 Apr 28 19:15:52 devstack sudo[86734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-fba112fc-b6e0-40e5-9ddc-8075b89b33e1 tempest-GroupsTest-1298413161 None] Lock "cinder-quobyte-981c4375-0d2f-4b77-be78-5826545b3fe0" released by "delete_volume" :: held 1.590s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:15:52 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-fba112fc-b6e0-40e5-9ddc-8075b89b33e1 tempest-GroupsTest-1298413161 None] Created reservations ['3e1281fe-aa47-4c86-bcc8-3c662f418a5e'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:15:52 devstack sudo[86736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7526626f-5011-4e33-823e-4a4342ed6f0c Apr 28 19:15:52 devstack sudo[86736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:52 devstack cinder-volume[83863]: WARNING cinder.quota [None req-fba112fc-b6e0-40e5-9ddc-8075b89b33e1 tempest-GroupsTest-1298413161 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1149904891 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1149904891, it is now deprecated. Please use the default quota class for default quota. Apr 28 19:15:52 devstack cinder-volume[83863]: WARNING cinder.quota [None req-fba112fc-b6e0-40e5-9ddc-8075b89b33e1 tempest-GroupsTest-1298413161 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1149904891 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1149904891, it is now deprecated. Please use the default quota class for default quota. Apr 28 19:15:52 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-fba112fc-b6e0-40e5-9ddc-8075b89b33e1 tempest-GroupsTest-1298413161 None] Created reservations ['7bba0bc3-c896-466b-a368-2def56fb7dbf', '29aadcc4-e231-4579-8345-7924234d2ca6', '66d3f6fb-240f-4b0a-8a6b-eee602750ccb', '79127429-8374-41ea-8f53-f9efbc43d1d2'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:15:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fba112fc-b6e0-40e5-9ddc-8075b89b33e1 tempest-GroupsTest-1298413161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:15:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fba112fc-b6e0-40e5-9ddc-8075b89b33e1 tempest-GroupsTest-1298413161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:15:53 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-fba112fc-b6e0-40e5-9ddc-8075b89b33e1 tempest-GroupsTest-1298413161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:15:53 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-fba112fc-b6e0-40e5-9ddc-8075b89b33e1 tempest-GroupsTest-1298413161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:15:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fba112fc-b6e0-40e5-9ddc-8075b89b33e1 tempest-GroupsTest-1298413161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:15:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fba112fc-b6e0-40e5-9ddc-8075b89b33e1 tempest-GroupsTest-1298413161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:53 devstack sudo[86739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:15:53 devstack sudo[86739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:53 devstack sudo[86734]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3a652638-06a2-4402-b4c6-f2f7b1dcca5d tempest-VolumesListAdminTestJSON-1716529319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5ed9f35d-662e-4ccf-b596-593439418bc3" returned: 0 in 0.947s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3a652638-06a2-4402-b4c6-f2f7b1dcca5d tempest-VolumesListAdminTestJSON-1716529319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5ed9f35d-662e-4ccf-b596-593439418bc3 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:53 devstack sudo[86744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5ed9f35d-662e-4ccf-b596-593439418bc3 Apr 28 19:15:53 devstack sudo[86744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:53 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-88c9f2e3-777c-4e9d-9d3b-79bf54182a1c tempest-GroupsTest-1298413161 None] Created reservations ['d13f00c9-979e-41b2-a634-4993d22f72e1'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:15:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-88c9f2e3-777c-4e9d-9d3b-79bf54182a1c tempest-GroupsTest-1298413161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:15:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-88c9f2e3-777c-4e9d-9d3b-79bf54182a1c tempest-GroupsTest-1298413161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:15:53 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-88c9f2e3-777c-4e9d-9d3b-79bf54182a1c tempest-GroupsTest-1298413161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:15:53 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-88c9f2e3-777c-4e9d-9d3b-79bf54182a1c tempest-GroupsTest-1298413161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:15:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-88c9f2e3-777c-4e9d-9d3b-79bf54182a1c tempest-GroupsTest-1298413161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:15:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-88c9f2e3-777c-4e9d-9d3b-79bf54182a1c tempest-GroupsTest-1298413161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:53 devstack sudo[86736]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-465b45fe-7b40-47a4-8503-cf90ccd3858a tempest-VolumesListAdminTestJSON-2014480160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7526626f-5011-4e33-823e-4a4342ed6f0c" returned: 0 in 1.177s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-465b45fe-7b40-47a4-8503-cf90ccd3858a tempest-VolumesListAdminTestJSON-2014480160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7526626f-5011-4e33-823e-4a4342ed6f0c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:53 devstack sudo[86751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:15:53 devstack sudo[86751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:53 devstack sudo[86752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7526626f-5011-4e33-823e-4a4342ed6f0c Apr 28 19:15:53 devstack sudo[86752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:53 devstack sudo[86739]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fba112fc-b6e0-40e5-9ddc-8075b89b33e1 tempest-GroupsTest-1298413161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.949s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:53 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-fba112fc-b6e0-40e5-9ddc-8075b89b33e1 tempest-GroupsTest-1298413161 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:15:54 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-fba112fc-b6e0-40e5-9ddc-8075b89b33e1 tempest-GroupsTest-1298413161 None] Delete group completed successfully. Apr 28 19:15:54 devstack sudo[86744]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3a652638-06a2-4402-b4c6-f2f7b1dcca5d tempest-VolumesListAdminTestJSON-1716529319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5ed9f35d-662e-4ccf-b596-593439418bc3" returned: 0 in 0.829s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:54 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3a652638-06a2-4402-b4c6-f2f7b1dcca5d tempest-VolumesListAdminTestJSON-1716529319 None] Lock "cinder-quobyte-5ed9f35d-662e-4ccf-b596-593439418bc3" released by "delete_volume" :: held 1.832s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:15:54 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-3a652638-06a2-4402-b4c6-f2f7b1dcca5d tempest-VolumesListAdminTestJSON-1716529319 None] Created reservations ['8a081b53-5522-4833-a14e-c27725e643f1', 'd8430a8f-f8b4-4d13-b936-457de425274f', '02f0587b-68fe-4be6-a319-3f53b30c4026', '550acf98-58ae-491b-8580-b35cd8833bba'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:15:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3a652638-06a2-4402-b4c6-f2f7b1dcca5d tempest-VolumesListAdminTestJSON-1716529319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:15:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3a652638-06a2-4402-b4c6-f2f7b1dcca5d tempest-VolumesListAdminTestJSON-1716529319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:15:54 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3a652638-06a2-4402-b4c6-f2f7b1dcca5d tempest-VolumesListAdminTestJSON-1716529319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:15:54 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3a652638-06a2-4402-b4c6-f2f7b1dcca5d tempest-VolumesListAdminTestJSON-1716529319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:15:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3a652638-06a2-4402-b4c6-f2f7b1dcca5d tempest-VolumesListAdminTestJSON-1716529319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:15:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3a652638-06a2-4402-b4c6-f2f7b1dcca5d tempest-VolumesListAdminTestJSON-1716529319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:54 devstack sudo[86756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:15:54 devstack sudo[86756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:54 devstack sudo[86751]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-88c9f2e3-777c-4e9d-9d3b-79bf54182a1c tempest-GroupsTest-1298413161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.754s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:54 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-88c9f2e3-777c-4e9d-9d3b-79bf54182a1c tempest-GroupsTest-1298413161 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:15:54 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-88c9f2e3-777c-4e9d-9d3b-79bf54182a1c tempest-GroupsTest-1298413161 None] Delete group completed successfully. Apr 28 19:15:54 devstack sudo[86752]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-465b45fe-7b40-47a4-8503-cf90ccd3858a tempest-VolumesListAdminTestJSON-2014480160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7526626f-5011-4e33-823e-4a4342ed6f0c" returned: 0 in 0.799s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:54 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-465b45fe-7b40-47a4-8503-cf90ccd3858a tempest-VolumesListAdminTestJSON-2014480160 None] Lock "cinder-quobyte-7526626f-5011-4e33-823e-4a4342ed6f0c" released by "delete_volume" :: held 2.038s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:15:54 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-465b45fe-7b40-47a4-8503-cf90ccd3858a tempest-VolumesListAdminTestJSON-2014480160 None] Created reservations ['762f3c83-b107-4944-93c2-649ffa84445f', 'a20668c3-6c60-4aa0-92e3-074fa5bac06d', 'f017d07d-d5ec-441c-9ec4-14f005320df5', '93d6f05c-cbed-40e1-b4ab-511b54353ef8'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:15:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-465b45fe-7b40-47a4-8503-cf90ccd3858a tempest-VolumesListAdminTestJSON-2014480160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:15:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-465b45fe-7b40-47a4-8503-cf90ccd3858a tempest-VolumesListAdminTestJSON-2014480160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:15:54 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-465b45fe-7b40-47a4-8503-cf90ccd3858a tempest-VolumesListAdminTestJSON-2014480160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:15:54 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-465b45fe-7b40-47a4-8503-cf90ccd3858a tempest-VolumesListAdminTestJSON-2014480160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:15:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-465b45fe-7b40-47a4-8503-cf90ccd3858a tempest-VolumesListAdminTestJSON-2014480160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:15:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-465b45fe-7b40-47a4-8503-cf90ccd3858a tempest-VolumesListAdminTestJSON-2014480160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:55 devstack sudo[86760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:15:55 devstack sudo[86760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:55 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-639d74d6-8659-4755-a16c-8073c7d1a768 tempest-GroupsV314Test-1953820929 None] Group tempest-GroupsV314Test-Group-1962163147: creating Apr 28 19:15:55 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-dd4fe87e-5cc8-446c-96df-2d4c93b49541 tempest-DeleteServersTestJSON-1034568749 None] Acquiring lock "cinder-5e50ff44-c79c-43b1-955d-fc92f513c0f5-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:15:55 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-639d74d6-8659-4755-a16c-8073c7d1a768 tempest-GroupsV314Test-1953820929 None] Group tempest-GroupsV314Test-Group-1962163147: created successfully Apr 28 19:15:55 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-dd4fe87e-5cc8-446c-96df-2d4c93b49541 tempest-DeleteServersTestJSON-1034568749 None] Lock "cinder-5e50ff44-c79c-43b1-955d-fc92f513c0f5-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:15:55 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-639d74d6-8659-4755-a16c-8073c7d1a768 tempest-GroupsV314Test-1953820929 None] Create group completed successfully. Apr 28 19:15:55 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-dd4fe87e-5cc8-446c-96df-2d4c93b49541 tempest-DeleteServersTestJSON-1034568749 None] Acquiring lock "cinder-quobyte-5e50ff44-c79c-43b1-955d-fc92f513c0f5" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:15:55 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-dd4fe87e-5cc8-446c-96df-2d4c93b49541 tempest-DeleteServersTestJSON-1034568749 None] Lock "cinder-quobyte-5e50ff44-c79c-43b1-955d-fc92f513c0f5" acquired by "delete_volume" :: waited 0.021s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:15:55 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3206694-bead-404c-ae6d-99f951a2f0c7]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:15:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-dd4fe87e-5cc8-446c-96df-2d4c93b49541 tempest-DeleteServersTestJSON-1034568749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5e50ff44-c79c-43b1-955d-fc92f513c0f5 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:55 devstack sudo[86756]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3a652638-06a2-4402-b4c6-f2f7b1dcca5d tempest-VolumesListAdminTestJSON-1716529319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.838s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:55 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-3a652638-06a2-4402-b4c6-f2f7b1dcca5d tempest-VolumesListAdminTestJSON-1716529319 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:15:55 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-3a652638-06a2-4402-b4c6-f2f7b1dcca5d tempest-VolumesListAdminTestJSON-1716529319 None] Deleted volume successfully. Apr 28 19:15:55 devstack sudo[86763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5e50ff44-c79c-43b1-955d-fc92f513c0f5 Apr 28 19:15:55 devstack sudo[86763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:55 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3a652638-06a2-4402-b4c6-f2f7b1dcca5d tempest-VolumesListAdminTestJSON-1716529319 None] Lock "cinder-5ed9f35d-662e-4ccf-b596-593439418bc3-delete_volume" released by "delete_volume" :: held 2.929s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:15:55 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-d430c694-696d-4bb2-8b63-7b3961336fb0 tempest-GroupsTest-1298413161 None] Group tempest-GroupsTest-Group-1868918147: creating Apr 28 19:15:55 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-d430c694-696d-4bb2-8b63-7b3961336fb0 tempest-GroupsTest-1298413161 None] Group tempest-GroupsTest-Group-1868918147: created successfully Apr 28 19:15:55 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-d430c694-696d-4bb2-8b63-7b3961336fb0 tempest-GroupsTest-1298413161 None] Create group completed successfully. Apr 28 19:15:55 devstack sudo[86760]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-465b45fe-7b40-47a4-8503-cf90ccd3858a tempest-VolumesListAdminTestJSON-2014480160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.793s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:55 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-465b45fe-7b40-47a4-8503-cf90ccd3858a tempest-VolumesListAdminTestJSON-2014480160 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:15:55 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-465b45fe-7b40-47a4-8503-cf90ccd3858a tempest-VolumesListAdminTestJSON-2014480160 None] Deleted volume successfully. Apr 28 19:15:55 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-465b45fe-7b40-47a4-8503-cf90ccd3858a tempest-VolumesListAdminTestJSON-2014480160 None] Lock "cinder-7526626f-5011-4e33-823e-4a4342ed6f0c-delete_volume" released by "delete_volume" :: held 3.152s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:15:55 devstack sudo[86763]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-dd4fe87e-5cc8-446c-96df-2d4c93b49541 tempest-DeleteServersTestJSON-1034568749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5e50ff44-c79c-43b1-955d-fc92f513c0f5" returned: 0 in 0.751s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-dd4fe87e-5cc8-446c-96df-2d4c93b49541 tempest-DeleteServersTestJSON-1034568749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5e50ff44-c79c-43b1-955d-fc92f513c0f5 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:56 devstack sudo[86769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5e50ff44-c79c-43b1-955d-fc92f513c0f5 Apr 28 19:15:56 devstack sudo[86769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:56 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-90606cc9-b27a-48b5-b258-d7c94ec66e31 tempest-VolumesListAdminTestJSON-2014480160 None] Acquiring lock "cinder-0417a0ce-38e4-4cdf-b7cd-37bfe51a30b6-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:15:56 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-90606cc9-b27a-48b5-b258-d7c94ec66e31 tempest-VolumesListAdminTestJSON-2014480160 None] Lock "cinder-0417a0ce-38e4-4cdf-b7cd-37bfe51a30b6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:15:56 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-90606cc9-b27a-48b5-b258-d7c94ec66e31 tempest-VolumesListAdminTestJSON-2014480160 None] Acquiring lock "cinder-quobyte-0417a0ce-38e4-4cdf-b7cd-37bfe51a30b6" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:15:56 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-90606cc9-b27a-48b5-b258-d7c94ec66e31 tempest-VolumesListAdminTestJSON-2014480160 None] Lock "cinder-quobyte-0417a0ce-38e4-4cdf-b7cd-37bfe51a30b6" acquired by "delete_volume" :: waited 0.019s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:15:56 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6505942-6b0e-44b6-b656-3e59f2e16a0e]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:15:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-90606cc9-b27a-48b5-b258-d7c94ec66e31 tempest-VolumesListAdminTestJSON-2014480160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-0417a0ce-38e4-4cdf-b7cd-37bfe51a30b6 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:56 devstack sudo[86771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-0417a0ce-38e4-4cdf-b7cd-37bfe51a30b6 Apr 28 19:15:56 devstack sudo[86771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:56 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-50b40e13-12cb-4956-834c-310d9bb55eb8 tempest-GroupsV314Test-1953820929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:15:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-50b40e13-12cb-4956-834c-310d9bb55eb8 tempest-GroupsV314Test-1953820929 None] Flow 'volume_create_manager' (10507468-ffda-4134-9c8d-ac5c01a01524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:15:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-50b40e13-12cb-4956-834c-310d9bb55eb8 tempest-GroupsV314Test-1953820929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98a8016b-ccaa-40e6-a547-4232008a9af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-50b40e13-12cb-4956-834c-310d9bb55eb8 tempest-GroupsV314Test-1953820929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98a8016b-ccaa-40e6-a547-4232008a9af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-74829535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2ae62931-4b2e-4215-a9fa-70998d0c9c5e,host='devstack@QuobyteHD#QuobyteHD',id=14a99b44-5ac1-47ec-9b18-3cbcc903187a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b18a804ba3824331b5608cf4690bbb9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:15:57Z,use_quota=True,user_id='3cbdbcd034ce4ceba23c56c1ec4e75ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(36180e22-353a-4d5b-9b49-28af4fb68720),volume_type_id=36180e22-353a-4d5b-9b49-28af4fb68720)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-50b40e13-12cb-4956-834c-310d9bb55eb8 tempest-GroupsV314Test-1953820929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43f67076-ac3a-49d2-a41a-4b638e1386c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-50b40e13-12cb-4956-834c-310d9bb55eb8 tempest-GroupsV314Test-1953820929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43f67076-ac3a-49d2-a41a-4b638e1386c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:56 devstack sudo[86769]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-50b40e13-12cb-4956-834c-310d9bb55eb8 tempest-GroupsV314Test-1953820929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab51e0d8-c6a9-469c-a145-09dfd2bd772b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-50b40e13-12cb-4956-834c-310d9bb55eb8 tempest-GroupsV314Test-1953820929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab51e0d8-c6a9-469c-a145-09dfd2bd772b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14a99b44-5ac1-47ec-9b18-3cbcc903187a', 'volume_name': 'volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-50b40e13-12cb-4956-834c-310d9bb55eb8 tempest-GroupsV314Test-1953820929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c649cd63-7e75-4780-8704-bdee974b7cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-50b40e13-12cb-4956-834c-310d9bb55eb8 tempest-GroupsV314Test-1953820929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c649cd63-7e75-4780-8704-bdee974b7cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-50b40e13-12cb-4956-834c-310d9bb55eb8 tempest-GroupsV314Test-1953820929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (392fb259-ba19-49e2-901e-ca512df5a262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:56 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-50b40e13-12cb-4956-834c-310d9bb55eb8 tempest-GroupsV314Test-1953820929 None] Volume 14a99b44-5ac1-47ec-9b18-3cbcc903187a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a', 'volume_size': 1} Apr 28 19:15:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-50b40e13-12cb-4956-834c-310d9bb55eb8 tempest-GroupsV314Test-1953820929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:15:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-50b40e13-12cb-4956-834c-310d9bb55eb8 tempest-GroupsV314Test-1953820929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:15:56 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-50b40e13-12cb-4956-834c-310d9bb55eb8 tempest-GroupsV314Test-1953820929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2ae62931-4b2e-4215-a9fa-70998d0c9c5e,created_at=2026-04-28T17:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-74829535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2ae62931-4b2e-4215-a9fa-70998d0c9c5e,host='devstack@QuobyteHD#QuobyteHD',id=14a99b44-5ac1-47ec-9b18-3cbcc903187a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b18a804ba3824331b5608cf4690bbb9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:15:57Z,use_quota=True,user_id='3cbdbcd034ce4ceba23c56c1ec4e75ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(36180e22-353a-4d5b-9b49-28af4fb68720),volume_type_id=36180e22-353a-4d5b-9b49-28af4fb68720)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:15:56 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-50b40e13-12cb-4956-834c-310d9bb55eb8 tempest-GroupsV314Test-1953820929 None] Creating volume 14a99b44-5ac1-47ec-9b18-3cbcc903187a {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:15:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-50b40e13-12cb-4956-834c-310d9bb55eb8 tempest-GroupsV314Test-1953820929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:15:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-50b40e13-12cb-4956-834c-310d9bb55eb8 tempest-GroupsV314Test-1953820929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:15:56 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-50b40e13-12cb-4956-834c-310d9bb55eb8 tempest-GroupsV314Test-1953820929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:15:56 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-50b40e13-12cb-4956-834c-310d9bb55eb8 tempest-GroupsV314Test-1953820929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:15:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-50b40e13-12cb-4956-834c-310d9bb55eb8 tempest-GroupsV314Test-1953820929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:15:56 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-50b40e13-12cb-4956-834c-310d9bb55eb8 tempest-GroupsV314Test-1953820929 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:15:56 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-50b40e13-12cb-4956-834c-310d9bb55eb8 tempest-GroupsV314Test-1953820929 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:15:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-50b40e13-12cb-4956-834c-310d9bb55eb8 tempest-GroupsV314Test-1953820929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-dd4fe87e-5cc8-446c-96df-2d4c93b49541 tempest-DeleteServersTestJSON-1034568749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5e50ff44-c79c-43b1-955d-fc92f513c0f5" returned: 0 in 0.699s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:56 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-dd4fe87e-5cc8-446c-96df-2d4c93b49541 tempest-DeleteServersTestJSON-1034568749 None] Lock "cinder-quobyte-5e50ff44-c79c-43b1-955d-fc92f513c0f5" released by "delete_volume" :: held 1.506s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:15:56 devstack sudo[86774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a 1073741824 Apr 28 19:15:56 devstack sudo[86774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:56 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-dd4fe87e-5cc8-446c-96df-2d4c93b49541 tempest-DeleteServersTestJSON-1034568749 None] Created reservations ['0cc0252b-6fa0-405b-94e7-dc1c18a3054d', 'a93ef47e-e6f1-4e65-a91a-5cebdce446da', '1d809d31-31d0-4b2a-b7e1-671ed53fca72', 'cc85ff70-6df0-4aba-b653-2aa010f426be'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:15:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-dd4fe87e-5cc8-446c-96df-2d4c93b49541 tempest-DeleteServersTestJSON-1034568749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:15:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-dd4fe87e-5cc8-446c-96df-2d4c93b49541 tempest-DeleteServersTestJSON-1034568749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:15:56 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-dd4fe87e-5cc8-446c-96df-2d4c93b49541 tempest-DeleteServersTestJSON-1034568749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:15:56 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-dd4fe87e-5cc8-446c-96df-2d4c93b49541 tempest-DeleteServersTestJSON-1034568749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:15:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-dd4fe87e-5cc8-446c-96df-2d4c93b49541 tempest-DeleteServersTestJSON-1034568749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:15:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-dd4fe87e-5cc8-446c-96df-2d4c93b49541 tempest-DeleteServersTestJSON-1034568749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:56 devstack sudo[86776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:15:56 devstack sudo[86776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:57 devstack sudo[86771]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-90606cc9-b27a-48b5-b258-d7c94ec66e31 tempest-VolumesListAdminTestJSON-2014480160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-0417a0ce-38e4-4cdf-b7cd-37bfe51a30b6" returned: 0 in 0.843s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-90606cc9-b27a-48b5-b258-d7c94ec66e31 tempest-VolumesListAdminTestJSON-2014480160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-0417a0ce-38e4-4cdf-b7cd-37bfe51a30b6 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:57 devstack sudo[86782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-0417a0ce-38e4-4cdf-b7cd-37bfe51a30b6 Apr 28 19:15:57 devstack sudo[86782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:57 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-924ed345-bfb5-47f2-8d0a-51e1a3ed8eeb tempest-GroupsTest-1298413161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:15:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-924ed345-bfb5-47f2-8d0a-51e1a3ed8eeb tempest-GroupsTest-1298413161 None] Flow 'volume_create_manager' (7ed69d46-c755-4159-aeea-0abd4b506f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:15:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-924ed345-bfb5-47f2-8d0a-51e1a3ed8eeb tempest-GroupsTest-1298413161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cb7c4e0-2c78-4b6e-9c06-6f473f1d266f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-924ed345-bfb5-47f2-8d0a-51e1a3ed8eeb tempest-GroupsTest-1298413161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cb7c4e0-2c78-4b6e-9c06-6f473f1d266f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1093265860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c45753f2-694d-4a10-93fc-03b512b170ef,host='devstack@QuobyteHD#QuobyteHD',id=f77a0d5f-db43-43d8-a37f-aea941fd4845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5607497568e740c7b48174c0deeb6b6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:15:57Z,use_quota=True,user_id='b880827c6a40403eb485d80ff072a698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca64e42f-fd99-4401-84e1-29240befdf4b),volume_type_id=ca64e42f-fd99-4401-84e1-29240befdf4b)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-924ed345-bfb5-47f2-8d0a-51e1a3ed8eeb tempest-GroupsTest-1298413161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (432bca74-6934-48d0-8c6a-6ee22432a879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-924ed345-bfb5-47f2-8d0a-51e1a3ed8eeb tempest-GroupsTest-1298413161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (432bca74-6934-48d0-8c6a-6ee22432a879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-924ed345-bfb5-47f2-8d0a-51e1a3ed8eeb tempest-GroupsTest-1298413161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4c93e5d-026b-4bac-8cf0-e722873587d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-924ed345-bfb5-47f2-8d0a-51e1a3ed8eeb tempest-GroupsTest-1298413161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4c93e5d-026b-4bac-8cf0-e722873587d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f77a0d5f-db43-43d8-a37f-aea941fd4845', 'volume_name': 'volume-f77a0d5f-db43-43d8-a37f-aea941fd4845', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-924ed345-bfb5-47f2-8d0a-51e1a3ed8eeb tempest-GroupsTest-1298413161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6617f9d7-0f94-4317-89e5-398cba0b6493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-924ed345-bfb5-47f2-8d0a-51e1a3ed8eeb tempest-GroupsTest-1298413161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6617f9d7-0f94-4317-89e5-398cba0b6493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-924ed345-bfb5-47f2-8d0a-51e1a3ed8eeb tempest-GroupsTest-1298413161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8c8b6e7-7375-4b75-8866-0c2ad06c237c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:57 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-924ed345-bfb5-47f2-8d0a-51e1a3ed8eeb tempest-GroupsTest-1298413161 None] Volume f77a0d5f-db43-43d8-a37f-aea941fd4845: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f77a0d5f-db43-43d8-a37f-aea941fd4845', 'volume_size': 1} Apr 28 19:15:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-924ed345-bfb5-47f2-8d0a-51e1a3ed8eeb tempest-GroupsTest-1298413161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:15:57 devstack sudo[86774]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-50b40e13-12cb-4956-834c-310d9bb55eb8 tempest-GroupsV314Test-1953820929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a 1073741824" returned: 0 in 1.032s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-50b40e13-12cb-4956-834c-310d9bb55eb8 tempest-GroupsV314Test-1953820929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:57 devstack sudo[86776]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-dd4fe87e-5cc8-446c-96df-2d4c93b49541 tempest-DeleteServersTestJSON-1034568749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.919s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:57 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-dd4fe87e-5cc8-446c-96df-2d4c93b49541 tempest-DeleteServersTestJSON-1034568749 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:15:57 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-dd4fe87e-5cc8-446c-96df-2d4c93b49541 tempest-DeleteServersTestJSON-1034568749 None] Deleted volume successfully. Apr 28 19:15:57 devstack sudo[86790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a Apr 28 19:15:57 devstack sudo[86790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:57 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-dd4fe87e-5cc8-446c-96df-2d4c93b49541 tempest-DeleteServersTestJSON-1034568749 None] Lock "cinder-5e50ff44-c79c-43b1-955d-fc92f513c0f5-delete_volume" released by "delete_volume" :: held 2.670s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:15:57 devstack sudo[86782]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-90606cc9-b27a-48b5-b258-d7c94ec66e31 tempest-VolumesListAdminTestJSON-2014480160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-0417a0ce-38e4-4cdf-b7cd-37bfe51a30b6" returned: 0 in 0.829s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:57 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-90606cc9-b27a-48b5-b258-d7c94ec66e31 tempest-VolumesListAdminTestJSON-2014480160 None] Lock "cinder-quobyte-0417a0ce-38e4-4cdf-b7cd-37bfe51a30b6" released by "delete_volume" :: held 1.714s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:15:57 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-90606cc9-b27a-48b5-b258-d7c94ec66e31 tempest-VolumesListAdminTestJSON-2014480160 None] Created reservations ['ed016436-023f-442f-9def-f2b302d48a9d', '0b9f83f0-f803-4bde-b379-305ec0180641', '85211805-a73e-4328-8d16-fad11316993d', '6195b3ef-2bdf-4669-8661-6fd84af0db71'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:15:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-90606cc9-b27a-48b5-b258-d7c94ec66e31 tempest-VolumesListAdminTestJSON-2014480160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:15:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-90606cc9-b27a-48b5-b258-d7c94ec66e31 tempest-VolumesListAdminTestJSON-2014480160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:15:57 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-90606cc9-b27a-48b5-b258-d7c94ec66e31 tempest-VolumesListAdminTestJSON-2014480160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:15:57 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-90606cc9-b27a-48b5-b258-d7c94ec66e31 tempest-VolumesListAdminTestJSON-2014480160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:15:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-90606cc9-b27a-48b5-b258-d7c94ec66e31 tempest-VolumesListAdminTestJSON-2014480160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:15:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-90606cc9-b27a-48b5-b258-d7c94ec66e31 tempest-VolumesListAdminTestJSON-2014480160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:58 devstack sudo[86792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:15:58 devstack sudo[86792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:58 devstack sudo[86790]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-50b40e13-12cb-4956-834c-310d9bb55eb8 tempest-GroupsV314Test-1953820929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a" returned: 0 in 0.693s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-50b40e13-12cb-4956-834c-310d9bb55eb8 tempest-GroupsV314Test-1953820929 None] <== create_volume: return (1782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:15:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-50b40e13-12cb-4956-834c-310d9bb55eb8 tempest-GroupsV314Test-1953820929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.784s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:15:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-924ed345-bfb5-47f2-8d0a-51e1a3ed8eeb tempest-GroupsTest-1298413161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.062s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:15:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-924ed345-bfb5-47f2-8d0a-51e1a3ed8eeb tempest-GroupsTest-1298413161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c45753f2-694d-4a10-93fc-03b512b170ef,created_at=2026-04-28T17:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1093265860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c45753f2-694d-4a10-93fc-03b512b170ef,host='devstack@QuobyteHD#QuobyteHD',id=f77a0d5f-db43-43d8-a37f-aea941fd4845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5607497568e740c7b48174c0deeb6b6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:15:57Z,use_quota=True,user_id='b880827c6a40403eb485d80ff072a698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca64e42f-fd99-4401-84e1-29240befdf4b),volume_type_id=ca64e42f-fd99-4401-84e1-29240befdf4b)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:15:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-924ed345-bfb5-47f2-8d0a-51e1a3ed8eeb tempest-GroupsTest-1298413161 None] Creating volume f77a0d5f-db43-43d8-a37f-aea941fd4845 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:15:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-924ed345-bfb5-47f2-8d0a-51e1a3ed8eeb tempest-GroupsTest-1298413161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:15:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-924ed345-bfb5-47f2-8d0a-51e1a3ed8eeb tempest-GroupsTest-1298413161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:15:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-924ed345-bfb5-47f2-8d0a-51e1a3ed8eeb tempest-GroupsTest-1298413161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:15:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-924ed345-bfb5-47f2-8d0a-51e1a3ed8eeb tempest-GroupsTest-1298413161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:15:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-924ed345-bfb5-47f2-8d0a-51e1a3ed8eeb tempest-GroupsTest-1298413161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:15:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-924ed345-bfb5-47f2-8d0a-51e1a3ed8eeb tempest-GroupsTest-1298413161 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:15:58 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-924ed345-bfb5-47f2-8d0a-51e1a3ed8eeb tempest-GroupsTest-1298413161 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:15:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-924ed345-bfb5-47f2-8d0a-51e1a3ed8eeb tempest-GroupsTest-1298413161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f77a0d5f-db43-43d8-a37f-aea941fd4845 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:58 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-67b02e56-71c5-426f-8e46-d86eef034699 tempest-VolumesListAdminTestJSON-2014480160 None] Acquiring lock "cinder-d26ab357-1dbe-4e4d-9b4b-0b8927414ce8-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:15:58 devstack sudo[86795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f77a0d5f-db43-43d8-a37f-aea941fd4845 1073741824 Apr 28 19:15:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-50b40e13-12cb-4956-834c-310d9bb55eb8 tempest-GroupsV314Test-1953820929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (392fb259-ba19-49e2-901e-ca512df5a262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:58 devstack sudo[86795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-50b40e13-12cb-4956-834c-310d9bb55eb8 tempest-GroupsV314Test-1953820929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4c6bc46-261a-4be0-a3b2-e27fd9456e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:15:58 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-67b02e56-71c5-426f-8e46-d86eef034699 tempest-VolumesListAdminTestJSON-2014480160 None] Lock "cinder-d26ab357-1dbe-4e4d-9b4b-0b8927414ce8-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:15:58 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-50b40e13-12cb-4956-834c-310d9bb55eb8 tempest-GroupsV314Test-1953820929 None] Volume volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a (14a99b44-5ac1-47ec-9b18-3cbcc903187a): created successfully Apr 28 19:15:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-50b40e13-12cb-4956-834c-310d9bb55eb8 tempest-GroupsV314Test-1953820929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4c6bc46-261a-4be0-a3b2-e27fd9456e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:15:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-50b40e13-12cb-4956-834c-310d9bb55eb8 tempest-GroupsV314Test-1953820929 None] Flow 'volume_create_manager' (10507468-ffda-4134-9c8d-ac5c01a01524) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:15:58 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-50b40e13-12cb-4956-834c-310d9bb55eb8 tempest-GroupsV314Test-1953820929 None] Created volume successfully. Apr 28 19:15:58 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-67b02e56-71c5-426f-8e46-d86eef034699 tempest-VolumesListAdminTestJSON-2014480160 None] Acquiring lock "cinder-quobyte-d26ab357-1dbe-4e4d-9b4b-0b8927414ce8" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:15:58 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-67b02e56-71c5-426f-8e46-d86eef034699 tempest-VolumesListAdminTestJSON-2014480160 None] Lock "cinder-quobyte-d26ab357-1dbe-4e4d-9b4b-0b8927414ce8" acquired by "delete_volume" :: waited 0.022s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:15:58 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9978d31f-731c-435c-80a3-a51065a05961]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:15:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-67b02e56-71c5-426f-8e46-d86eef034699 tempest-VolumesListAdminTestJSON-2014480160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d26ab357-1dbe-4e4d-9b4b-0b8927414ce8 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:58 devstack sudo[86792]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-90606cc9-b27a-48b5-b258-d7c94ec66e31 tempest-VolumesListAdminTestJSON-2014480160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.807s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:58 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-90606cc9-b27a-48b5-b258-d7c94ec66e31 tempest-VolumesListAdminTestJSON-2014480160 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:15:58 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-90606cc9-b27a-48b5-b258-d7c94ec66e31 tempest-VolumesListAdminTestJSON-2014480160 None] Deleted volume successfully. Apr 28 19:15:58 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-90606cc9-b27a-48b5-b258-d7c94ec66e31 tempest-VolumesListAdminTestJSON-2014480160 None] Lock "cinder-0417a0ce-38e4-4cdf-b7cd-37bfe51a30b6-delete_volume" released by "delete_volume" :: held 2.740s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:15:58 devstack sudo[86798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d26ab357-1dbe-4e4d-9b4b-0b8927414ce8 Apr 28 19:15:58 devstack sudo[86798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:59 devstack sudo[86795]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-924ed345-bfb5-47f2-8d0a-51e1a3ed8eeb tempest-GroupsTest-1298413161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f77a0d5f-db43-43d8-a37f-aea941fd4845 1073741824" returned: 0 in 1.023s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-924ed345-bfb5-47f2-8d0a-51e1a3ed8eeb tempest-GroupsTest-1298413161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f77a0d5f-db43-43d8-a37f-aea941fd4845 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:59 devstack sudo[86807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f77a0d5f-db43-43d8-a37f-aea941fd4845 Apr 28 19:15:59 devstack sudo[86807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:15:59 devstack sudo[86798]: pam_unix(sudo:session): session closed for user root Apr 28 19:15:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-67b02e56-71c5-426f-8e46-d86eef034699 tempest-VolumesListAdminTestJSON-2014480160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d26ab357-1dbe-4e4d-9b4b-0b8927414ce8" returned: 0 in 0.907s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:15:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-67b02e56-71c5-426f-8e46-d86eef034699 tempest-VolumesListAdminTestJSON-2014480160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d26ab357-1dbe-4e4d-9b4b-0b8927414ce8 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:15:59 devstack sudo[86809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d26ab357-1dbe-4e4d-9b4b-0b8927414ce8 Apr 28 19:15:59 devstack sudo[86809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:16:00 devstack sudo[86809]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-67b02e56-71c5-426f-8e46-d86eef034699 tempest-VolumesListAdminTestJSON-2014480160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d26ab357-1dbe-4e4d-9b4b-0b8927414ce8" returned: 0 in 0.705s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:00 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-67b02e56-71c5-426f-8e46-d86eef034699 tempest-VolumesListAdminTestJSON-2014480160 None] Lock "cinder-quobyte-d26ab357-1dbe-4e4d-9b4b-0b8927414ce8" released by "delete_volume" :: held 1.667s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:16:00 devstack sudo[86807]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-924ed345-bfb5-47f2-8d0a-51e1a3ed8eeb tempest-GroupsTest-1298413161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f77a0d5f-db43-43d8-a37f-aea941fd4845" returned: 0 in 0.799s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-924ed345-bfb5-47f2-8d0a-51e1a3ed8eeb tempest-GroupsTest-1298413161 None] <== create_volume: return (1867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:16:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-924ed345-bfb5-47f2-8d0a-51e1a3ed8eeb tempest-GroupsTest-1298413161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.873s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:16:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.288s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:16:00 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] Cloning volume 14a99b44-5ac1-47ec-9b18-3cbcc903187a to volume f4b761b5-9796-44fa-8e0f-19d6a7d8d043 Apr 28 19:16:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-924ed345-bfb5-47f2-8d0a-51e1a3ed8eeb tempest-GroupsTest-1298413161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8c8b6e7-7375-4b75-8866-0c2ad06c237c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f77a0d5f-db43-43d8-a37f-aea941fd4845', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:16:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-924ed345-bfb5-47f2-8d0a-51e1a3ed8eeb tempest-GroupsTest-1298413161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df602fdb-86a6-46c6-b868-b777723a4b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:16:00 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-924ed345-bfb5-47f2-8d0a-51e1a3ed8eeb tempest-GroupsTest-1298413161 None] Volume volume-f77a0d5f-db43-43d8-a37f-aea941fd4845 (f77a0d5f-db43-43d8-a37f-aea941fd4845): created successfully Apr 28 19:16:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-924ed345-bfb5-47f2-8d0a-51e1a3ed8eeb tempest-GroupsTest-1298413161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df602fdb-86a6-46c6-b868-b777723a4b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:16:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-924ed345-bfb5-47f2-8d0a-51e1a3ed8eeb tempest-GroupsTest-1298413161 None] Flow 'volume_create_manager' (7ed69d46-c755-4159-aeea-0abd4b506f82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:16:00 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-924ed345-bfb5-47f2-8d0a-51e1a3ed8eeb tempest-GroupsTest-1298413161 None] Created volume successfully. Apr 28 19:16:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] Creating offline snapshot a825de16-f8ff-456e-99f4-57af4080cfac of volume 14a99b44-5ac1-47ec-9b18-3cbcc903187a {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 19:16:00 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7c35e8-b67e-462e-a52f-e4c7dfa7c412]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:16:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:00 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-67b02e56-71c5-426f-8e46-d86eef034699 tempest-VolumesListAdminTestJSON-2014480160 None] Created reservations ['4e5947ba-1e2c-4922-9b27-e8bcaad4fb7b', 'bfa2b357-f7a8-4c35-bd44-73bc630b932f', 'fee706c4-f579-4492-852a-df037636a1af', '13af8169-506c-49b5-9114-371a76f59639'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:16:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-67b02e56-71c5-426f-8e46-d86eef034699 tempest-VolumesListAdminTestJSON-2014480160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:16:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-67b02e56-71c5-426f-8e46-d86eef034699 tempest-VolumesListAdminTestJSON-2014480160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:16:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-67b02e56-71c5-426f-8e46-d86eef034699 tempest-VolumesListAdminTestJSON-2014480160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:16:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-67b02e56-71c5-426f-8e46-d86eef034699 tempest-VolumesListAdminTestJSON-2014480160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:16:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-67b02e56-71c5-426f-8e46-d86eef034699 tempest-VolumesListAdminTestJSON-2014480160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:16:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-67b02e56-71c5-426f-8e46-d86eef034699 tempest-VolumesListAdminTestJSON-2014480160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:00 devstack sudo[86816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a Apr 28 19:16:00 devstack sudo[86816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:00 devstack sudo[86817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:16:00 devstack sudo[86817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:01 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-54bbbc48-b67b-4a4e-a6e5-951bed2431f3 tempest-GroupsTest-1298413161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:16:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-54bbbc48-b67b-4a4e-a6e5-951bed2431f3 tempest-GroupsTest-1298413161 None] Flow 'volume_create_manager' (96c203a2-f120-46dc-8796-619ac8037c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:16:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-54bbbc48-b67b-4a4e-a6e5-951bed2431f3 tempest-GroupsTest-1298413161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cd8629d-362b-4f2f-b2a3-d2b67fdaf563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:16:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-54bbbc48-b67b-4a4e-a6e5-951bed2431f3 tempest-GroupsTest-1298413161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cd8629d-362b-4f2f-b2a3-d2b67fdaf563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:16:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-841341541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c45753f2-694d-4a10-93fc-03b512b170ef,host='devstack@QuobyteHD#QuobyteHD',id=945f6128-9573-496d-8fdc-35013480dfe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5607497568e740c7b48174c0deeb6b6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:16:01Z,use_quota=True,user_id='b880827c6a40403eb485d80ff072a698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca64e42f-fd99-4401-84e1-29240befdf4b),volume_type_id=ca64e42f-fd99-4401-84e1-29240befdf4b)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:16:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-54bbbc48-b67b-4a4e-a6e5-951bed2431f3 tempest-GroupsTest-1298413161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f20c4d6-f744-460e-b85e-9b6ccaf39601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:16:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-54bbbc48-b67b-4a4e-a6e5-951bed2431f3 tempest-GroupsTest-1298413161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f20c4d6-f744-460e-b85e-9b6ccaf39601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:16:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-54bbbc48-b67b-4a4e-a6e5-951bed2431f3 tempest-GroupsTest-1298413161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ce20cb5-7fba-4179-8fe5-cc37840a5a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:16:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-54bbbc48-b67b-4a4e-a6e5-951bed2431f3 tempest-GroupsTest-1298413161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ce20cb5-7fba-4179-8fe5-cc37840a5a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '945f6128-9573-496d-8fdc-35013480dfe3', 'volume_name': 'volume-945f6128-9573-496d-8fdc-35013480dfe3', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:16:01 devstack sudo[86817]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-54bbbc48-b67b-4a4e-a6e5-951bed2431f3 tempest-GroupsTest-1298413161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a69e919e-cfb7-4f9e-abeb-8ebf2d73433c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:16:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-54bbbc48-b67b-4a4e-a6e5-951bed2431f3 tempest-GroupsTest-1298413161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a69e919e-cfb7-4f9e-abeb-8ebf2d73433c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:16:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-54bbbc48-b67b-4a4e-a6e5-951bed2431f3 tempest-GroupsTest-1298413161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f326944-d498-4809-96ed-f22db74a2aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:16:01 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-54bbbc48-b67b-4a4e-a6e5-951bed2431f3 tempest-GroupsTest-1298413161 None] Volume 945f6128-9573-496d-8fdc-35013480dfe3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-945f6128-9573-496d-8fdc-35013480dfe3', 'volume_size': 1} Apr 28 19:16:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-54bbbc48-b67b-4a4e-a6e5-951bed2431f3 tempest-GroupsTest-1298413161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:16:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-67b02e56-71c5-426f-8e46-d86eef034699 tempest-VolumesListAdminTestJSON-2014480160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.910s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:01 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-67b02e56-71c5-426f-8e46-d86eef034699 tempest-VolumesListAdminTestJSON-2014480160 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:16:01 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-67b02e56-71c5-426f-8e46-d86eef034699 tempest-VolumesListAdminTestJSON-2014480160 None] Deleted volume successfully. Apr 28 19:16:01 devstack sudo[86816]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a" returned: 0 in 1.115s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a.a825de16-f8ff-456e-99f4-57af4080cfac 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:01 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-67b02e56-71c5-426f-8e46-d86eef034699 tempest-VolumesListAdminTestJSON-2014480160 None] Lock "cinder-d26ab357-1dbe-4e4d-9b4b-0b8927414ce8-delete_volume" released by "delete_volume" :: held 3.059s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:16:01 devstack sudo[86824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a.a825de16-f8ff-456e-99f4-57af4080cfac 1G Apr 28 19:16:01 devstack sudo[86824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:02 devstack sudo[86824]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a.a825de16-f8ff-456e-99f4-57af4080cfac 1G" returned: 0 in 0.903s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a.a825de16-f8ff-456e-99f4-57af4080cfac {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:02 devstack sudo[86831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a.a825de16-f8ff-456e-99f4-57af4080cfac Apr 28 19:16:02 devstack sudo[86831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:03 devstack sudo[86831]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a.a825de16-f8ff-456e-99f4-57af4080cfac" returned: 0 in 0.724s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:03 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a.a825de16-f8ff-456e-99f4-57af4080cfac is being set with open permissions: ugo+rw: NotImplementedError Apr 28 19:16:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a.a825de16-f8ff-456e-99f4-57af4080cfac {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:03 devstack sudo[86836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a.a825de16-f8ff-456e-99f4-57af4080cfac Apr 28 19:16:03 devstack sudo[86836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:03 devstack cinder-volume[83863]: DEBUG oslo_service.periodic_task [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 28 19:16:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:16:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:16:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:16:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:16:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:16:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:03 devstack sudo[86838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:16:03 devstack sudo[86838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:04 devstack sudo[86836]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a.a825de16-f8ff-456e-99f4-57af4080cfac" returned: 0 in 0.790s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:04 devstack sudo[86841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a.info Apr 28 19:16:04 devstack sudo[86841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:04 devstack sudo[86838]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.764s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:04 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:16:04 devstack sudo[86841]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a.info" returned: 0 in 0.691s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:04 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a.info is being set with open permissions: ugo+rw: NotImplementedError Apr 28 19:16:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:04 devstack sudo[86845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a.info Apr 28 19:16:04 devstack sudo[86845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:05 devstack sudo[86845]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a.info" returned: 0 in 0.682s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:05 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] Acquiring lock "cinder-quobyte-f4b761b5-9796-44fa-8e0f-19d6a7d8d043" by "_copy_volume_from_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:16:05 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] Lock "cinder-quobyte-f4b761b5-9796-44fa-8e0f-19d6a7d8d043" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:16:05 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] snapshot: a825de16-f8ff-456e-99f4-57af4080cfac, volume: f4b761b5-9796-44fa-8e0f-19d6a7d8d043, {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 19:16:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:16:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:16:05 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:16:05 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:16:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:16:05 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54e52cd-16d8-4442-b167-df0938757583]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:16:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a.a825de16-f8ff-456e-99f4-57af4080cfac {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:05 devstack sudo[86848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a.a825de16-f8ff-456e-99f4-57af4080cfac Apr 28 19:16:05 devstack sudo[86848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:06 devstack sudo[86848]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a.a825de16-f8ff-456e-99f4-57af4080cfac" returned: 0 in 0.877s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:06 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:16:06 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 19:16:06 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] Creating direct copy from snapshot {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 19:16:06 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3ba31a-f44e-42e8-a8bf-d3d0556402db]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:16:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:06 devstack sudo[86853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a Apr 28 19:16:06 devstack sudo[86853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:07 devstack sudo[86853]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a" returned: 0 in 0.842s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:07 devstack cinder-volume[83863]: DEBUG cinder.utils [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] Path /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f4b761b5-9796-44fa-8e0f-19d6a7d8d043 not found in is_blk_device check {{(pid=83863) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 19:16:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f4b761b5-9796-44fa-8e0f-19d6a7d8d043 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:07 devstack sudo[86859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f4b761b5-9796-44fa-8e0f-19d6a7d8d043 Apr 28 19:16:07 devstack sudo[86859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:10 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:16:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Flow 'volume_create_manager' (b7841a5a-770b-44fa-899a-a0a619ed57d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:16:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d144d9bf-5c8f-4599-949b-900f6cb540e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:16:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d144d9bf-5c8f-4599-949b-900f6cb540e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1084199248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a540ff9f3d224804802ee699899801cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:16:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:16:10Z,use_quota=True,user_id='9130727edf1644d38459d23dea355075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:16:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f444ef3-ab61-4913-a582-b13b990d77e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:16:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f444ef3-ab61-4913-a582-b13b990d77e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:16:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72f61210-9615-4c75-a41c-c5742f61b485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:16:10 devstack cinder-volume[83863]: DEBUG cinder.image.glance [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Creating Keystone auth plugin from conf {{(pid=83863) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 28 19:16:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72f61210-9615-4c75-a41c-c5742f61b485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a', 'volume_name': 'volume-da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a', 'volume_size': 1, 'image_id': 'd11adb91-6b52-452f-a796-9ef8412183bf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d11adb91-6b52-452f-a796-9ef8412183bf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6469daf89505401a8582e1f501a60d80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd11adb91-6b52-452f-a796-9ef8412183bf', 'created_at': datetime.datetime(2026, 4, 28, 17, 9, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 17, 9, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d11adb91-6b52-452f-a796-9ef8412183bf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:16:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00fe7c0a-5db7-4863-8adf-a0c1502845c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:16:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00fe7c0a-5db7-4863-8adf-a0c1502845c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:16:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ea7b076-37f5-4602-8389-87777bd97827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:16:11 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Volume da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a', 'volume_size': 1, 'image_id': 'd11adb91-6b52-452f-a796-9ef8412183bf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d11adb91-6b52-452f-a796-9ef8412183bf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6469daf89505401a8582e1f501a60d80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd11adb91-6b52-452f-a796-9ef8412183bf', 'created_at': datetime.datetime(2026, 4, 28, 17, 9, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 17, 9, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d11adb91-6b52-452f-a796-9ef8412183bf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 28 19:16:11 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Trying to clone da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a from image d11adb91-6b52-452f-a796-9ef8412183bf at location (None, [{'url': 'file:///opt/stack/data/glance/images/d11adb91-6b52-452f-a796-9ef8412183bf', 'metadata': {}}]). {{(pid=83863) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Apr 28 19:16:12 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_juc833vgdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83863) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 28 19:16:12 devstack cinder-volume[83863]: INFO cinder.image.image_utils [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Image download 20.69 MB at 20.69 MB/s Apr 28 19:16:12 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc8a746-a058-40e9-8146-7f8a437dc6d2]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:16:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_juc833vgdevstack@QuobyteHD {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:12 devstack sudo[86907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_juc833vgdevstack@QuobyteHD Apr 28 19:16:12 devstack sudo[86907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:13 devstack sudo[86859]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f4b761b5-9796-44fa-8e0f-19d6a7d8d043" returned: 0 in 6.527s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:13 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0d8434-20e6-4a32-a8be-f809790f25f0]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:16:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:13 devstack sudo[86907]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_juc833vgdevstack@QuobyteHD" returned: 0 in 1.468s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:13 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Temporary image d11adb91-6b52-452f-a796-9ef8412183bf is fetched for user 9130727edf1644d38459d23dea355075. {{(pid=83863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 28 19:16:13 devstack sudo[86913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a Apr 28 19:16:13 devstack sudo[86913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:13 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[713210d2-eb1d-4225-a22c-0c01f1b51275]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:16:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_juc833vgdevstack@QuobyteHD {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:14 devstack sudo[86915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_juc833vgdevstack@QuobyteHD Apr 28 19:16:14 devstack sudo[86915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:14 devstack sudo[86915]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:14 devstack sudo[86913]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_juc833vgdevstack@QuobyteHD" returned: 0 in 0.789s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:16:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a" returned: 0 in 0.966s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:14 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] Image conversion details: src /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a, size 1024.00 MB, duration 6.53 sec, destination /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f4b761b5-9796-44fa-8e0f-19d6a7d8d043 {{(pid=83863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 19:16:14 devstack cinder-volume[83863]: INFO cinder.image.image_utils [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] Converted 1024.00 MB image at 156.84 MB/s Apr 28 19:16:14 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f4b761b5-9796-44fa-8e0f-19d6a7d8d043 is being set with open permissions: ugo+rw: NotImplementedError Apr 28 19:16:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f4b761b5-9796-44fa-8e0f-19d6a7d8d043 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:14 devstack sudo[86923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f4b761b5-9796-44fa-8e0f-19d6a7d8d043 Apr 28 19:16:14 devstack sudo[86923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:15 devstack sudo[86923]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f4b761b5-9796-44fa-8e0f-19d6a7d8d043" returned: 0 in 0.634s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:15 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] Lock "cinder-quobyte-f4b761b5-9796-44fa-8e0f-19d6a7d8d043" released by "_copy_volume_from_snapshot" :: held 9.931s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:16:15 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] Acquiring lock "cinder-quobyte-a825de16-f8ff-456e-99f4-57af4080cfac" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:16:15 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] Lock "cinder-quobyte-a825de16-f8ff-456e-99f4-57af4080cfac" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:16:15 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] Deleting offline snapshot a825de16-f8ff-456e-99f4-57af4080cfac of volume 14a99b44-5ac1-47ec-9b18-3cbcc903187a {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 19:16:15 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] snapshot_file for this snap is: volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a.a825de16-f8ff-456e-99f4-57af4080cfac {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 19:16:15 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2727a9-5680-47fd-b11c-2b8b8e70d76a]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:16:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a.a825de16-f8ff-456e-99f4-57af4080cfac {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:15 devstack sudo[86926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a.a825de16-f8ff-456e-99f4-57af4080cfac Apr 28 19:16:15 devstack sudo[86926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:16 devstack sudo[86926]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a.a825de16-f8ff-456e-99f4-57af4080cfac" returned: 0 in 0.783s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:16 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:16:16 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f365d0-8f29-4f1f-b23a-ba9e65fcbf7a]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:16:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:16 devstack sudo[86931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a Apr 28 19:16:16 devstack sudo[86931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:17 devstack sudo[86931]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a" returned: 0 in 0.747s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a.a825de16-f8ff-456e-99f4-57af4080cfac {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:17 devstack sudo[86936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a.a825de16-f8ff-456e-99f4-57af4080cfac Apr 28 19:16:17 devstack sudo[86936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:17 devstack sudo[86936]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a.a825de16-f8ff-456e-99f4-57af4080cfac" returned: 0 in 0.761s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a.a825de16-f8ff-456e-99f4-57af4080cfac {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:17 devstack sudo[86942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a.a825de16-f8ff-456e-99f4-57af4080cfac Apr 28 19:16:17 devstack sudo[86942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:18 devstack sudo[86942]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a.a825de16-f8ff-456e-99f4-57af4080cfac" returned: 0 in 0.604s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:18 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] Lock "cinder-quobyte-a825de16-f8ff-456e-99f4-57af4080cfac" released by "_delete_snapshot" :: held 3.009s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:16:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.121s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:16:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-54bbbc48-b67b-4a4e-a6e5-951bed2431f3 tempest-GroupsTest-1298413161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.906s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:16:18 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-54bbbc48-b67b-4a4e-a6e5-951bed2431f3 tempest-GroupsTest-1298413161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c45753f2-694d-4a10-93fc-03b512b170ef,created_at=2026-04-28T17:16:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-841341541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c45753f2-694d-4a10-93fc-03b512b170ef,host='devstack@QuobyteHD#QuobyteHD',id=945f6128-9573-496d-8fdc-35013480dfe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5607497568e740c7b48174c0deeb6b6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:16:01Z,use_quota=True,user_id='b880827c6a40403eb485d80ff072a698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca64e42f-fd99-4401-84e1-29240befdf4b),volume_type_id=ca64e42f-fd99-4401-84e1-29240befdf4b)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:16:18 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-54bbbc48-b67b-4a4e-a6e5-951bed2431f3 tempest-GroupsTest-1298413161 None] Creating volume 945f6128-9573-496d-8fdc-35013480dfe3 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:16:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-54bbbc48-b67b-4a4e-a6e5-951bed2431f3 tempest-GroupsTest-1298413161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:16:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-54bbbc48-b67b-4a4e-a6e5-951bed2431f3 tempest-GroupsTest-1298413161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:16:18 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-54bbbc48-b67b-4a4e-a6e5-951bed2431f3 tempest-GroupsTest-1298413161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:16:18 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-54bbbc48-b67b-4a4e-a6e5-951bed2431f3 tempest-GroupsTest-1298413161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:16:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-54bbbc48-b67b-4a4e-a6e5-951bed2431f3 tempest-GroupsTest-1298413161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:16:18 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-54bbbc48-b67b-4a4e-a6e5-951bed2431f3 tempest-GroupsTest-1298413161 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:16:18 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-54bbbc48-b67b-4a4e-a6e5-951bed2431f3 tempest-GroupsTest-1298413161 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:16:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-54bbbc48-b67b-4a4e-a6e5-951bed2431f3 tempest-GroupsTest-1298413161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-945f6128-9573-496d-8fdc-35013480dfe3 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:18 devstack sudo[86945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-945f6128-9573-496d-8fdc-35013480dfe3 1073741824 Apr 28 19:16:18 devstack sudo[86945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:18 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-d209072d-153e-4a8b-9d5f-18a5b7dad554 tempest-GroupsV314Test-1953820929 None] Create group from source-group-2ae62931-4b2e-4215-a9fa-70998d0c9c5e completed successfully. Apr 28 19:16:19 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-190f9b54-51ca-423e-b545-29f9d175b17f tempest-GroupsV314Test-1953820929 None] Acquiring lock "cinder-quobyte-f4b761b5-9796-44fa-8e0f-19d6a7d8d043" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:16:19 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-190f9b54-51ca-423e-b545-29f9d175b17f tempest-GroupsV314Test-1953820929 None] Lock "cinder-quobyte-f4b761b5-9796-44fa-8e0f-19d6a7d8d043" acquired by "delete_volume" :: waited 0.020s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:16:19 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e26f83-26f0-4266-a35a-7f0c44771fae]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:16:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-190f9b54-51ca-423e-b545-29f9d175b17f tempest-GroupsV314Test-1953820929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f4b761b5-9796-44fa-8e0f-19d6a7d8d043 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:19 devstack sudo[86950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f4b761b5-9796-44fa-8e0f-19d6a7d8d043 Apr 28 19:16:19 devstack sudo[86950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:19 devstack sudo[86945]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-54bbbc48-b67b-4a4e-a6e5-951bed2431f3 tempest-GroupsTest-1298413161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-945f6128-9573-496d-8fdc-35013480dfe3 1073741824" returned: 0 in 1.017s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-54bbbc48-b67b-4a4e-a6e5-951bed2431f3 tempest-GroupsTest-1298413161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-945f6128-9573-496d-8fdc-35013480dfe3 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:19 devstack sudo[86953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-945f6128-9573-496d-8fdc-35013480dfe3 Apr 28 19:16:19 devstack sudo[86953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:20 devstack sudo[86950]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-190f9b54-51ca-423e-b545-29f9d175b17f tempest-GroupsV314Test-1953820929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f4b761b5-9796-44fa-8e0f-19d6a7d8d043" returned: 0 in 0.784s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-190f9b54-51ca-423e-b545-29f9d175b17f tempest-GroupsV314Test-1953820929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f4b761b5-9796-44fa-8e0f-19d6a7d8d043 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:20 devstack sudo[86958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f4b761b5-9796-44fa-8e0f-19d6a7d8d043 Apr 28 19:16:20 devstack sudo[86958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:20 devstack sudo[86953]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-54bbbc48-b67b-4a4e-a6e5-951bed2431f3 tempest-GroupsTest-1298413161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-945f6128-9573-496d-8fdc-35013480dfe3" returned: 0 in 0.665s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:20 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-54bbbc48-b67b-4a4e-a6e5-951bed2431f3 tempest-GroupsTest-1298413161 None] <== create_volume: return (1725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:16:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-54bbbc48-b67b-4a4e-a6e5-951bed2431f3 tempest-GroupsTest-1298413161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.727s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:16:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.443s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:16:20 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1084199248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a540ff9f3d224804802ee699899801cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:16:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:16:10Z,use_quota=True,user_id='9130727edf1644d38459d23dea355075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:16:20 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Creating volume da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:16:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:16:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:16:20 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:16:20 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:16:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:16:20 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:16:20 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:16:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:20 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-54bbbc48-b67b-4a4e-a6e5-951bed2431f3 tempest-GroupsTest-1298413161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f326944-d498-4809-96ed-f22db74a2aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-945f6128-9573-496d-8fdc-35013480dfe3', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:16:20 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-54bbbc48-b67b-4a4e-a6e5-951bed2431f3 tempest-GroupsTest-1298413161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c11377d3-2d38-440e-b786-e9c9440741bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:16:20 devstack sudo[86961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a 1073741824 Apr 28 19:16:20 devstack sudo[86961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:20 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-54bbbc48-b67b-4a4e-a6e5-951bed2431f3 tempest-GroupsTest-1298413161 None] Volume volume-945f6128-9573-496d-8fdc-35013480dfe3 (945f6128-9573-496d-8fdc-35013480dfe3): created successfully Apr 28 19:16:20 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-54bbbc48-b67b-4a4e-a6e5-951bed2431f3 tempest-GroupsTest-1298413161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c11377d3-2d38-440e-b786-e9c9440741bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:16:20 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-54bbbc48-b67b-4a4e-a6e5-951bed2431f3 tempest-GroupsTest-1298413161 None] Flow 'volume_create_manager' (96c203a2-f120-46dc-8796-619ac8037c1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:16:20 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-54bbbc48-b67b-4a4e-a6e5-951bed2431f3 tempest-GroupsTest-1298413161 None] Created volume successfully. Apr 28 19:16:20 devstack sudo[86958]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-190f9b54-51ca-423e-b545-29f9d175b17f tempest-GroupsV314Test-1953820929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f4b761b5-9796-44fa-8e0f-19d6a7d8d043" returned: 0 in 0.668s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-190f9b54-51ca-423e-b545-29f9d175b17f tempest-GroupsV314Test-1953820929 None] Lock "cinder-quobyte-f4b761b5-9796-44fa-8e0f-19d6a7d8d043" released by "delete_volume" :: held 1.509s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:16:20 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-190f9b54-51ca-423e-b545-29f9d175b17f tempest-GroupsV314Test-1953820929 None] Created reservations ['f29d971a-228d-4560-92c0-3515fdf86ae2'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:16:20 devstack cinder-volume[83863]: WARNING cinder.quota [None req-190f9b54-51ca-423e-b545-29f9d175b17f tempest-GroupsV314Test-1953820929 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-847109627 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-847109627, it is now deprecated. Please use the default quota class for default quota. Apr 28 19:16:20 devstack cinder-volume[83863]: WARNING cinder.quota [None req-190f9b54-51ca-423e-b545-29f9d175b17f tempest-GroupsV314Test-1953820929 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-847109627 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-847109627, it is now deprecated. Please use the default quota class for default quota. Apr 28 19:16:20 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-190f9b54-51ca-423e-b545-29f9d175b17f tempest-GroupsV314Test-1953820929 None] Created reservations ['b60aadd3-61dd-4d72-9d18-80a7af68ad39', '2d0ee80c-51f7-4e19-bba8-10eb6e68505e', 'cfa7d3e4-061d-48bd-83c3-89732c4caef6', '1ac98912-b480-4648-a9fa-68d8021d6ec9'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:16:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-190f9b54-51ca-423e-b545-29f9d175b17f tempest-GroupsV314Test-1953820929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:16:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-190f9b54-51ca-423e-b545-29f9d175b17f tempest-GroupsV314Test-1953820929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:16:20 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-190f9b54-51ca-423e-b545-29f9d175b17f tempest-GroupsV314Test-1953820929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:16:20 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-190f9b54-51ca-423e-b545-29f9d175b17f tempest-GroupsV314Test-1953820929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:16:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-190f9b54-51ca-423e-b545-29f9d175b17f tempest-GroupsV314Test-1953820929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:16:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-190f9b54-51ca-423e-b545-29f9d175b17f tempest-GroupsV314Test-1953820929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:21 devstack sudo[86973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:16:21 devstack sudo[86973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:21 devstack sudo[86961]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a 1073741824" returned: 0 in 0.968s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:21 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-7801d6b3-1dd3-4198-8cf8-ae33434fdf1a tempest-GroupsTest-1298413161 None] Update group completed successfully. Apr 28 19:16:21 devstack sudo[86975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a Apr 28 19:16:21 devstack sudo[86975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:21 devstack sudo[86973]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-190f9b54-51ca-423e-b545-29f9d175b17f tempest-GroupsV314Test-1953820929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.650s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:21 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-190f9b54-51ca-423e-b545-29f9d175b17f tempest-GroupsV314Test-1953820929 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:16:21 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-190f9b54-51ca-423e-b545-29f9d175b17f tempest-GroupsV314Test-1953820929 None] Delete group completed successfully. Apr 28 19:16:21 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3c7dfb43-468d-421b-b13a-50bde207d9bc tempest-GroupsV314Test-1953820929 None] Acquiring lock "cinder-quobyte-14a99b44-5ac1-47ec-9b18-3cbcc903187a" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:16:21 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3c7dfb43-468d-421b-b13a-50bde207d9bc tempest-GroupsV314Test-1953820929 None] Lock "cinder-quobyte-14a99b44-5ac1-47ec-9b18-3cbcc903187a" acquired by "delete_volume" :: waited 0.016s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:16:21 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c425065-8984-4fe8-ac91-1b4e0b19f257]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:16:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3c7dfb43-468d-421b-b13a-50bde207d9bc tempest-GroupsV314Test-1953820929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:21 devstack sudo[86980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a Apr 28 19:16:21 devstack sudo[86980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:21 devstack sudo[86975]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a" returned: 0 in 0.692s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:21 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] <== create_volume: return (1727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:16:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.729s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:16:21 devstack cinder-volume[83863]: DEBUG cinder.volume.volume_utils [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Attempting download of d11adb91-6b52-452f-a796-9ef8412183bf ((None, [{'url': 'file:///opt/stack/data/glance/images/d11adb91-6b52-452f-a796-9ef8412183bf', 'metadata': {}}])) to volume da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a. {{(pid=83863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 28 19:16:22 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbeb382f-73ea-4265-9127-ae596657a46c]: (4, 'raw') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:16:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d11adb91-6b52-452f-a796-9ef8412183bf_0xqgf9ct {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:22 devstack sudo[86983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d11adb91-6b52-452f-a796-9ef8412183bf_0xqgf9ct Apr 28 19:16:22 devstack sudo[86983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:22 devstack sudo[86980]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3c7dfb43-468d-421b-b13a-50bde207d9bc tempest-GroupsV314Test-1953820929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a" returned: 0 in 0.754s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3c7dfb43-468d-421b-b13a-50bde207d9bc tempest-GroupsV314Test-1953820929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:22 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-79ad61f5-edb5-4029-8df3-ffd51c2ed060 tempest-GroupsTest-1298413161 None] Update group completed successfully. Apr 28 19:16:22 devstack sudo[86988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a Apr 28 19:16:22 devstack sudo[86988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:22 devstack sudo[86983]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d11adb91-6b52-452f-a796-9ef8412183bf_0xqgf9ct" returned: 0 in 0.763s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d11adb91-6b52-452f-a796-9ef8412183bf_0xqgf9ct {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:22 devstack sudo[86992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d11adb91-6b52-452f-a796-9ef8412183bf_0xqgf9ct Apr 28 19:16:22 devstack sudo[86992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:23 devstack sudo[86988]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3c7dfb43-468d-421b-b13a-50bde207d9bc tempest-GroupsV314Test-1953820929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-14a99b44-5ac1-47ec-9b18-3cbcc903187a" returned: 0 in 0.648s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:23 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3c7dfb43-468d-421b-b13a-50bde207d9bc tempest-GroupsV314Test-1953820929 None] Lock "cinder-quobyte-14a99b44-5ac1-47ec-9b18-3cbcc903187a" released by "delete_volume" :: held 1.489s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:16:23 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-3c7dfb43-468d-421b-b13a-50bde207d9bc tempest-GroupsV314Test-1953820929 None] Created reservations ['5dde09d6-33ab-49e5-b24b-a5b4033b7972'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:16:23 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-3c7dfb43-468d-421b-b13a-50bde207d9bc tempest-GroupsV314Test-1953820929 None] Created reservations ['fa4a41d2-8397-45bd-8234-6c4bb64d4b8d', '2ed4b126-15e6-44c9-bdde-52f00c7cb219', '82022cd1-dd55-4387-97ad-7dba789d5e81', '9ccc37c6-d745-4c00-b614-19656c315371'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:16:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3c7dfb43-468d-421b-b13a-50bde207d9bc tempest-GroupsV314Test-1953820929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:16:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3c7dfb43-468d-421b-b13a-50bde207d9bc tempest-GroupsV314Test-1953820929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:16:23 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3c7dfb43-468d-421b-b13a-50bde207d9bc tempest-GroupsV314Test-1953820929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:16:23 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3c7dfb43-468d-421b-b13a-50bde207d9bc tempest-GroupsV314Test-1953820929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:16:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3c7dfb43-468d-421b-b13a-50bde207d9bc tempest-GroupsV314Test-1953820929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:16:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3c7dfb43-468d-421b-b13a-50bde207d9bc tempest-GroupsV314Test-1953820929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:23 devstack sudo[86997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:16:23 devstack sudo[86997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:23 devstack sudo[86992]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d11adb91-6b52-452f-a796-9ef8412183bf_0xqgf9ct" returned: 1 in 0.712s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d11adb91-6b52-452f-a796-9ef8412183bf_0xqgf9ct' failed. Not Retrying. {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 19:16:23 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[218dbd6a-0565-47a1-b07d-9d2c0fcc12ec]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:16:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_juc833vgdevstack@QuobyteHD {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:23 devstack sudo[86999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_juc833vgdevstack@QuobyteHD Apr 28 19:16:23 devstack sudo[86999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:24 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-855af478-1972-44d6-95b0-ff82dd641ad9 tempest-GroupsTest-1298413161 None] Acquiring lock "cinder-quobyte-945f6128-9573-496d-8fdc-35013480dfe3" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:16:24 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-855af478-1972-44d6-95b0-ff82dd641ad9 tempest-GroupsTest-1298413161 None] Lock "cinder-quobyte-945f6128-9573-496d-8fdc-35013480dfe3" acquired by "delete_volume" :: waited 0.028s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:16:24 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2310ff0d-5a22-40b3-b72c-b0c545811d93]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:16:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-855af478-1972-44d6-95b0-ff82dd641ad9 tempest-GroupsTest-1298413161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-945f6128-9573-496d-8fdc-35013480dfe3 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:24 devstack sudo[86997]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3c7dfb43-468d-421b-b13a-50bde207d9bc tempest-GroupsV314Test-1953820929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.725s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:24 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-3c7dfb43-468d-421b-b13a-50bde207d9bc tempest-GroupsV314Test-1953820929 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:16:24 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-3c7dfb43-468d-421b-b13a-50bde207d9bc tempest-GroupsV314Test-1953820929 None] Delete group completed successfully. Apr 28 19:16:24 devstack sudo[87002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-945f6128-9573-496d-8fdc-35013480dfe3 Apr 28 19:16:24 devstack sudo[87002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:24 devstack sudo[86999]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_juc833vgdevstack@QuobyteHD" returned: 0 in 0.828s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:24 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] d11adb91-6b52-452f-a796-9ef8412183bf was qcow2, converting to raw {{(pid=83863) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 28 19:16:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_juc833vgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:24 devstack sudo[87008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_juc833vgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a Apr 28 19:16:24 devstack sudo[87008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:24 devstack sudo[87002]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-855af478-1972-44d6-95b0-ff82dd641ad9 tempest-GroupsTest-1298413161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-945f6128-9573-496d-8fdc-35013480dfe3" returned: 0 in 0.841s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-855af478-1972-44d6-95b0-ff82dd641ad9 tempest-GroupsTest-1298413161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-945f6128-9573-496d-8fdc-35013480dfe3 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:24 devstack sudo[87015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-945f6128-9573-496d-8fdc-35013480dfe3 Apr 28 19:16:24 devstack sudo[87015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:25 devstack sudo[87015]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-855af478-1972-44d6-95b0-ff82dd641ad9 tempest-GroupsTest-1298413161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-945f6128-9573-496d-8fdc-35013480dfe3" returned: 0 in 0.746s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:25 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-855af478-1972-44d6-95b0-ff82dd641ad9 tempest-GroupsTest-1298413161 None] Lock "cinder-quobyte-945f6128-9573-496d-8fdc-35013480dfe3" released by "delete_volume" :: held 1.651s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:16:25 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-855af478-1972-44d6-95b0-ff82dd641ad9 tempest-GroupsTest-1298413161 None] Acquiring lock "cinder-quobyte-f77a0d5f-db43-43d8-a37f-aea941fd4845" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:16:25 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-855af478-1972-44d6-95b0-ff82dd641ad9 tempest-GroupsTest-1298413161 None] Lock "cinder-quobyte-f77a0d5f-db43-43d8-a37f-aea941fd4845" acquired by "delete_volume" :: waited 0.020s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:16:25 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba57e20d-2db6-46b4-89e6-12cbe1864f15]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:16:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-855af478-1972-44d6-95b0-ff82dd641ad9 tempest-GroupsTest-1298413161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f77a0d5f-db43-43d8-a37f-aea941fd4845 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:25 devstack sudo[87028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f77a0d5f-db43-43d8-a37f-aea941fd4845 Apr 28 19:16:25 devstack sudo[87028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:26 devstack sudo[87008]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_juc833vgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a" returned: 0 in 2.525s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:26 devstack sudo[87028]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:26 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_juc833vgdevstack@QuobyteHD, size 112.00 MB, duration 2.53 sec, destination /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a {{(pid=83863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 19:16:26 devstack cinder-volume[83863]: INFO cinder.image.image_utils [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Converted 112.00 MB image at 44.33 MB/s Apr 28 19:16:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-855af478-1972-44d6-95b0-ff82dd641ad9 tempest-GroupsTest-1298413161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f77a0d5f-db43-43d8-a37f-aea941fd4845" returned: 0 in 1.155s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-855af478-1972-44d6-95b0-ff82dd641ad9 tempest-GroupsTest-1298413161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f77a0d5f-db43-43d8-a37f-aea941fd4845 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:26 devstack sudo[87034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a 1G Apr 28 19:16:26 devstack sudo[87034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:26 devstack sudo[87035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f77a0d5f-db43-43d8-a37f-aea941fd4845 Apr 28 19:16:26 devstack sudo[87035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:27 devstack sudo[87035]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-855af478-1972-44d6-95b0-ff82dd641ad9 tempest-GroupsTest-1298413161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f77a0d5f-db43-43d8-a37f-aea941fd4845" returned: 0 in 0.835s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:27 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-855af478-1972-44d6-95b0-ff82dd641ad9 tempest-GroupsTest-1298413161 None] Lock "cinder-quobyte-f77a0d5f-db43-43d8-a37f-aea941fd4845" released by "delete_volume" :: held 2.053s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:16:27 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:SELECT=138,cinder:UPDATE=170,cinder:INSERT=35,cinder:DELETE=8 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 19:16:27 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:SELECT=151,cinder:INSERT=39,cinder:UPDATE=164,cinder:DELETE=12 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 19:16:27 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-855af478-1972-44d6-95b0-ff82dd641ad9 tempest-GroupsTest-1298413161 None] Created reservations ['dfb312c4-1f7e-4f9e-b0be-31fbf9b74bca'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:16:27 devstack sudo[87034]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a 1G" returned: 0 in 1.065s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:27 devstack cinder-volume[83863]: WARNING cinder.quota [None req-855af478-1972-44d6-95b0-ff82dd641ad9 tempest-GroupsTest-1298413161 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-831431870 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-831431870, it is now deprecated. Please use the default quota class for default quota. Apr 28 19:16:27 devstack cinder-volume[83863]: WARNING cinder.quota [None req-855af478-1972-44d6-95b0-ff82dd641ad9 tempest-GroupsTest-1298413161 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-831431870 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-831431870, it is now deprecated. Please use the default quota class for default quota. Apr 28 19:16:27 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-855af478-1972-44d6-95b0-ff82dd641ad9 tempest-GroupsTest-1298413161 None] Created reservations ['03c8c875-d7de-4ccb-9e5b-6fa506f748e9', '21181137-c056-44f1-bc7e-a66c6f01bd39', '3bfa6fda-2aac-49cf-b2c3-fad100bab008', '0c80fd12-2616-4a75-9c8c-968f4698dc16'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:16:28 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c445226-06d3-426b-aa3d-fd556f3cbc97]: (4, 'raw') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:16:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:28 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-855af478-1972-44d6-95b0-ff82dd641ad9 tempest-GroupsTest-1298413161 None] Created reservations ['cb7840a3-cf8d-4a60-8e47-1b3380307ba0', 'b3956252-16df-4e69-b7f2-e3f87f8d5149', '96494269-56c8-4982-b2f5-796140f86c83', '1cac20d3-194b-4e51-bb19-84e5346991b6'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:16:28 devstack sudo[87049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a Apr 28 19:16:28 devstack sudo[87049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-855af478-1972-44d6-95b0-ff82dd641ad9 tempest-GroupsTest-1298413161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:16:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-855af478-1972-44d6-95b0-ff82dd641ad9 tempest-GroupsTest-1298413161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:16:28 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-855af478-1972-44d6-95b0-ff82dd641ad9 tempest-GroupsTest-1298413161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:16:28 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-855af478-1972-44d6-95b0-ff82dd641ad9 tempest-GroupsTest-1298413161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:16:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-855af478-1972-44d6-95b0-ff82dd641ad9 tempest-GroupsTest-1298413161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:16:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-855af478-1972-44d6-95b0-ff82dd641ad9 tempest-GroupsTest-1298413161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:28 devstack sudo[87058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:16:28 devstack sudo[87058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:29 devstack sudo[87049]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a" returned: 0 in 1.088s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:29 devstack sudo[87058]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-855af478-1972-44d6-95b0-ff82dd641ad9 tempest-GroupsTest-1298413161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.852s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:29 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-855af478-1972-44d6-95b0-ff82dd641ad9 tempest-GroupsTest-1298413161 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:16:29 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-855af478-1972-44d6-95b0-ff82dd641ad9 tempest-GroupsTest-1298413161 None] Delete group completed successfully. Apr 28 19:16:29 devstack sudo[87066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a Apr 28 19:16:29 devstack sudo[87066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:29 devstack sudo[87066]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a" returned: 1 in 0.886s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a' failed. Not Retrying. {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 19:16:29 devstack cinder-volume[83863]: DEBUG cinder.volume.volume_utils [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Downloaded image d11adb91-6b52-452f-a796-9ef8412183bf ((None, [{'url': 'file:///opt/stack/data/glance/images/d11adb91-6b52-452f-a796-9ef8412183bf', 'metadata': {}}])) to volume da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a successfully. {{(pid=83863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 28 19:16:30 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Temporary image d11adb91-6b52-452f-a796-9ef8412183bf for user 9130727edf1644d38459d23dea355075 is deleted. {{(pid=83863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 28 19:16:30 devstack cinder-volume[83863]: DEBUG cinder.volume.volume_utils [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Marking volume da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a as bootable. {{(pid=83863) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 28 19:16:30 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Copying metadata from image d11adb91-6b52-452f-a796-9ef8412183bf to da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a. {{(pid=83863) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 28 19:16:30 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Creating volume glance metadata for volume da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a backed by image d11adb91-6b52-452f-a796-9ef8412183bf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd11adb91-6b52-452f-a796-9ef8412183bf', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83863) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 28 19:16:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ea7b076-37f5-4602-8389-87777bd97827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a', 'volume_size': 1, 'image_id': 'd11adb91-6b52-452f-a796-9ef8412183bf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d11adb91-6b52-452f-a796-9ef8412183bf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6469daf89505401a8582e1f501a60d80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd11adb91-6b52-452f-a796-9ef8412183bf', 'created_at': datetime.datetime(2026, 4, 28, 17, 9, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 17, 9, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d11adb91-6b52-452f-a796-9ef8412183bf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:16:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4883d2d8-a1c1-475b-82a4-e65839c737c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:16:30 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Volume volume-da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a (da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a): created successfully Apr 28 19:16:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4883d2d8-a1c1-475b-82a4-e65839c737c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:16:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Flow 'volume_create_manager' (b7841a5a-770b-44fa-899a-a0a619ed57d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:16:30 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-23f5f8e3-8096-490f-b74d-69e1d7799b3c tempest-VolumesImageMetadata-1829391205 None] Created volume successfully. Apr 28 19:16:31 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-18d162bc-c1cb-4f92-aa3e-4a7a4300392c tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:16:31 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-18d162bc-c1cb-4f92-aa3e-4a7a4300392c tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Flow 'volume_create_manager' (a15badcb-3a58-48e2-9ff7-30a58c3e9c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:16:31 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-18d162bc-c1cb-4f92-aa3e-4a7a4300392c tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bcc1e7b-fd1c-4e67-8592-e99b7cd0740f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:16:31 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-18d162bc-c1cb-4f92-aa3e-4a7a4300392c tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bcc1e7b-fd1c-4e67-8592-e99b7cd0740f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-265537369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21c80b65-0dae-40e7-b7b3-97e9e89e88ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b66c42c7a5f4cde8a10fb6108aa015f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:16:31Z,use_quota=True,user_id='f6b5a3d72801432b971c9dde8e43203a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1bdbe34f-e677-48df-8e08-3ac3e37ec786),volume_type_id=1bdbe34f-e677-48df-8e08-3ac3e37ec786)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:16:31 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-18d162bc-c1cb-4f92-aa3e-4a7a4300392c tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02e74dd8-bb88-406c-8e44-cb856eb092ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:16:31 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-18d162bc-c1cb-4f92-aa3e-4a7a4300392c tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02e74dd8-bb88-406c-8e44-cb856eb092ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:16:31 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-18d162bc-c1cb-4f92-aa3e-4a7a4300392c tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8835e32e-b4b6-4d90-a528-ef8d43bdd44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:16:31 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-18d162bc-c1cb-4f92-aa3e-4a7a4300392c tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8835e32e-b4b6-4d90-a528-ef8d43bdd44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21c80b65-0dae-40e7-b7b3-97e9e89e88ee', 'volume_name': 'volume-21c80b65-0dae-40e7-b7b3-97e9e89e88ee', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:16:31 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-18d162bc-c1cb-4f92-aa3e-4a7a4300392c tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff32d701-2950-4c7d-bb7c-a3a341bd69aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:16:31 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-18d162bc-c1cb-4f92-aa3e-4a7a4300392c tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff32d701-2950-4c7d-bb7c-a3a341bd69aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:16:31 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-18d162bc-c1cb-4f92-aa3e-4a7a4300392c tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a32529ea-f218-4e04-926c-e9e166316138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:16:31 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-18d162bc-c1cb-4f92-aa3e-4a7a4300392c tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Volume 21c80b65-0dae-40e7-b7b3-97e9e89e88ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21c80b65-0dae-40e7-b7b3-97e9e89e88ee', 'volume_size': 1} Apr 28 19:16:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-18d162bc-c1cb-4f92-aa3e-4a7a4300392c tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:16:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-18d162bc-c1cb-4f92-aa3e-4a7a4300392c tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:16:31 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-18d162bc-c1cb-4f92-aa3e-4a7a4300392c tempest-VolumeRetypeWithoutMigrationTest-227321252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-265537369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21c80b65-0dae-40e7-b7b3-97e9e89e88ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b66c42c7a5f4cde8a10fb6108aa015f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:16:31Z,use_quota=True,user_id='f6b5a3d72801432b971c9dde8e43203a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1bdbe34f-e677-48df-8e08-3ac3e37ec786),volume_type_id=1bdbe34f-e677-48df-8e08-3ac3e37ec786)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:16:31 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-18d162bc-c1cb-4f92-aa3e-4a7a4300392c tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Creating volume 21c80b65-0dae-40e7-b7b3-97e9e89e88ee {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:16:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-18d162bc-c1cb-4f92-aa3e-4a7a4300392c tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:16:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-18d162bc-c1cb-4f92-aa3e-4a7a4300392c tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:16:31 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-18d162bc-c1cb-4f92-aa3e-4a7a4300392c tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:16:31 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-18d162bc-c1cb-4f92-aa3e-4a7a4300392c tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:16:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-18d162bc-c1cb-4f92-aa3e-4a7a4300392c tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:16:31 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-18d162bc-c1cb-4f92-aa3e-4a7a4300392c tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:16:31 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-18d162bc-c1cb-4f92-aa3e-4a7a4300392c tempest-VolumeRetypeWithoutMigrationTest-227321252 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:16:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-18d162bc-c1cb-4f92-aa3e-4a7a4300392c tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-21c80b65-0dae-40e7-b7b3-97e9e89e88ee 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:31 devstack sudo[87079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-21c80b65-0dae-40e7-b7b3-97e9e89e88ee 1073741824 Apr 28 19:16:31 devstack sudo[87079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:31 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8a176739-27a3-481f-9e76-3e5a1a0320d5 tempest-VolumesImageMetadata-1829391205 None] Acquiring lock "cinder-da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:16:31 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8a176739-27a3-481f-9e76-3e5a1a0320d5 tempest-VolumesImageMetadata-1829391205 None] Lock "cinder-da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:16:31 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8a176739-27a3-481f-9e76-3e5a1a0320d5 tempest-VolumesImageMetadata-1829391205 None] Acquiring lock "cinder-quobyte-da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:16:31 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8a176739-27a3-481f-9e76-3e5a1a0320d5 tempest-VolumesImageMetadata-1829391205 None] Lock "cinder-quobyte-da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a" acquired by "delete_volume" :: waited 0.024s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:16:31 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a99069-8922-430c-951d-46f5af3fea8c]: (4, 'raw') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:16:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8a176739-27a3-481f-9e76-3e5a1a0320d5 tempest-VolumesImageMetadata-1829391205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:31 devstack sudo[87108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a Apr 28 19:16:31 devstack sudo[87108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:32 devstack sudo[87079]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-18d162bc-c1cb-4f92-aa3e-4a7a4300392c tempest-VolumeRetypeWithoutMigrationTest-227321252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-21c80b65-0dae-40e7-b7b3-97e9e89e88ee 1073741824" returned: 0 in 1.205s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-18d162bc-c1cb-4f92-aa3e-4a7a4300392c tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-21c80b65-0dae-40e7-b7b3-97e9e89e88ee {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:32 devstack sudo[87123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-21c80b65-0dae-40e7-b7b3-97e9e89e88ee Apr 28 19:16:32 devstack sudo[87123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:32 devstack sudo[87108]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8a176739-27a3-481f-9e76-3e5a1a0320d5 tempest-VolumesImageMetadata-1829391205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a" returned: 0 in 1.159s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8a176739-27a3-481f-9e76-3e5a1a0320d5 tempest-VolumesImageMetadata-1829391205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:32 devstack sudo[87125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a Apr 28 19:16:32 devstack sudo[87125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:33 devstack sudo[87123]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-18d162bc-c1cb-4f92-aa3e-4a7a4300392c tempest-VolumeRetypeWithoutMigrationTest-227321252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-21c80b65-0dae-40e7-b7b3-97e9e89e88ee" returned: 0 in 0.660s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-18d162bc-c1cb-4f92-aa3e-4a7a4300392c tempest-VolumeRetypeWithoutMigrationTest-227321252 None] <== create_volume: return (1954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:16:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-18d162bc-c1cb-4f92-aa3e-4a7a4300392c tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.957s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:16:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-18d162bc-c1cb-4f92-aa3e-4a7a4300392c tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a32529ea-f218-4e04-926c-e9e166316138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21c80b65-0dae-40e7-b7b3-97e9e89e88ee', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:16:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-18d162bc-c1cb-4f92-aa3e-4a7a4300392c tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6c96754-4ae5-4bbe-b91a-b68483377417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:16:33 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-18d162bc-c1cb-4f92-aa3e-4a7a4300392c tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Volume volume-21c80b65-0dae-40e7-b7b3-97e9e89e88ee (21c80b65-0dae-40e7-b7b3-97e9e89e88ee): created successfully Apr 28 19:16:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-18d162bc-c1cb-4f92-aa3e-4a7a4300392c tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6c96754-4ae5-4bbe-b91a-b68483377417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:16:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-18d162bc-c1cb-4f92-aa3e-4a7a4300392c tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Flow 'volume_create_manager' (a15badcb-3a58-48e2-9ff7-30a58c3e9c61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:16:33 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-18d162bc-c1cb-4f92-aa3e-4a7a4300392c tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Created volume successfully. Apr 28 19:16:33 devstack sudo[87125]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8a176739-27a3-481f-9e76-3e5a1a0320d5 tempest-VolumesImageMetadata-1829391205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a" returned: 1 in 0.812s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8a176739-27a3-481f-9e76-3e5a1a0320d5 tempest-VolumesImageMetadata-1829391205 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a' failed. Not Retrying. {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 19:16:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8a176739-27a3-481f-9e76-3e5a1a0320d5 tempest-VolumesImageMetadata-1829391205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:33 devstack sudo[87131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a Apr 28 19:16:33 devstack sudo[87131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:34 devstack sudo[87131]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8a176739-27a3-481f-9e76-3e5a1a0320d5 tempest-VolumesImageMetadata-1829391205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a" returned: 0 in 1.321s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:34 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8a176739-27a3-481f-9e76-3e5a1a0320d5 tempest-VolumesImageMetadata-1829391205 None] Lock "cinder-quobyte-da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a" released by "delete_volume" :: held 3.397s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:16:35 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-8a176739-27a3-481f-9e76-3e5a1a0320d5 tempest-VolumesImageMetadata-1829391205 None] Created reservations ['fbee51fe-a70f-46f3-b213-66c896163bae', '615e1376-7e8e-4ba2-8656-99b3a5025f7a', '75383965-ff00-4d96-8bbc-e73a810ddc75', '6585214e-dad2-466b-8142-42db0b2d0368'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:16:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8a176739-27a3-481f-9e76-3e5a1a0320d5 tempest-VolumesImageMetadata-1829391205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:16:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8a176739-27a3-481f-9e76-3e5a1a0320d5 tempest-VolumesImageMetadata-1829391205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:16:35 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-8a176739-27a3-481f-9e76-3e5a1a0320d5 tempest-VolumesImageMetadata-1829391205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:16:35 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-8a176739-27a3-481f-9e76-3e5a1a0320d5 tempest-VolumesImageMetadata-1829391205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:16:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8a176739-27a3-481f-9e76-3e5a1a0320d5 tempest-VolumesImageMetadata-1829391205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:16:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8a176739-27a3-481f-9e76-3e5a1a0320d5 tempest-VolumesImageMetadata-1829391205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:35 devstack sudo[87201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:16:35 devstack sudo[87201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f5640110-40cc-4bf1-98b4-c829c5007a26 tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:16:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f5640110-40cc-4bf1-98b4-c829c5007a26 tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:16:35 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f5640110-40cc-4bf1-98b4-c829c5007a26 tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:16:35 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f5640110-40cc-4bf1-98b4-c829c5007a26 tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:16:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f5640110-40cc-4bf1-98b4-c829c5007a26 tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:16:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f5640110-40cc-4bf1-98b4-c829c5007a26 tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:35 devstack sudo[87203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:16:35 devstack sudo[87203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:35 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-3984b873-36df-4ea5-a38e-8301bd2130a0 tempest-SnapshotsActionsTest-904821522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:16:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3984b873-36df-4ea5-a38e-8301bd2130a0 tempest-SnapshotsActionsTest-904821522 None] Flow 'volume_create_manager' (93e38019-ebd1-4203-a79e-5dcb91daf788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:16:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3984b873-36df-4ea5-a38e-8301bd2130a0 tempest-SnapshotsActionsTest-904821522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5b75954-922c-41ac-aaae-0043b481e914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:16:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3984b873-36df-4ea5-a38e-8301bd2130a0 tempest-SnapshotsActionsTest-904821522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5b75954-922c-41ac-aaae-0043b481e914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1026333401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da601bc0-f975-4bd3-8926-4b6098299f9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f89543b306564081b2aebdd8f00beec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:16:36Z,use_quota=True,user_id='6ab68d54ec2643f18caa4d0009561f36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:16:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3984b873-36df-4ea5-a38e-8301bd2130a0 tempest-SnapshotsActionsTest-904821522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8708cce2-e3e6-4b1b-83bb-4ca14fc12a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:16:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3984b873-36df-4ea5-a38e-8301bd2130a0 tempest-SnapshotsActionsTest-904821522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8708cce2-e3e6-4b1b-83bb-4ca14fc12a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:16:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3984b873-36df-4ea5-a38e-8301bd2130a0 tempest-SnapshotsActionsTest-904821522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5588cbfb-59c8-4d37-8f32-e490267857f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:16:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3984b873-36df-4ea5-a38e-8301bd2130a0 tempest-SnapshotsActionsTest-904821522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5588cbfb-59c8-4d37-8f32-e490267857f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da601bc0-f975-4bd3-8926-4b6098299f9d', 'volume_name': 'volume-da601bc0-f975-4bd3-8926-4b6098299f9d', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:16:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3984b873-36df-4ea5-a38e-8301bd2130a0 tempest-SnapshotsActionsTest-904821522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9abcd87-58c5-4d2c-9e55-a99de9600ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:16:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3984b873-36df-4ea5-a38e-8301bd2130a0 tempest-SnapshotsActionsTest-904821522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9abcd87-58c5-4d2c-9e55-a99de9600ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:16:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3984b873-36df-4ea5-a38e-8301bd2130a0 tempest-SnapshotsActionsTest-904821522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a7e56d7-87ae-41bc-9996-5c76afa2c7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:16:35 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-3984b873-36df-4ea5-a38e-8301bd2130a0 tempest-SnapshotsActionsTest-904821522 None] Volume da601bc0-f975-4bd3-8926-4b6098299f9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da601bc0-f975-4bd3-8926-4b6098299f9d', 'volume_size': 1} Apr 28 19:16:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3984b873-36df-4ea5-a38e-8301bd2130a0 tempest-SnapshotsActionsTest-904821522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:16:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3984b873-36df-4ea5-a38e-8301bd2130a0 tempest-SnapshotsActionsTest-904821522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:16:35 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3984b873-36df-4ea5-a38e-8301bd2130a0 tempest-SnapshotsActionsTest-904821522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1026333401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da601bc0-f975-4bd3-8926-4b6098299f9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f89543b306564081b2aebdd8f00beec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:16:36Z,use_quota=True,user_id='6ab68d54ec2643f18caa4d0009561f36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:16:35 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-3984b873-36df-4ea5-a38e-8301bd2130a0 tempest-SnapshotsActionsTest-904821522 None] Creating volume da601bc0-f975-4bd3-8926-4b6098299f9d {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:16:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3984b873-36df-4ea5-a38e-8301bd2130a0 tempest-SnapshotsActionsTest-904821522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:16:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3984b873-36df-4ea5-a38e-8301bd2130a0 tempest-SnapshotsActionsTest-904821522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:16:35 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3984b873-36df-4ea5-a38e-8301bd2130a0 tempest-SnapshotsActionsTest-904821522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:16:35 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3984b873-36df-4ea5-a38e-8301bd2130a0 tempest-SnapshotsActionsTest-904821522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:16:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3984b873-36df-4ea5-a38e-8301bd2130a0 tempest-SnapshotsActionsTest-904821522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:16:35 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3984b873-36df-4ea5-a38e-8301bd2130a0 tempest-SnapshotsActionsTest-904821522 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:16:35 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-3984b873-36df-4ea5-a38e-8301bd2130a0 tempest-SnapshotsActionsTest-904821522 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:16:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3984b873-36df-4ea5-a38e-8301bd2130a0 tempest-SnapshotsActionsTest-904821522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:36 devstack sudo[87201]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:36 devstack sudo[87206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d 1073741824 Apr 28 19:16:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8a176739-27a3-481f-9e76-3e5a1a0320d5 tempest-VolumesImageMetadata-1829391205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.779s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:36 devstack sudo[87206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:36 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-8a176739-27a3-481f-9e76-3e5a1a0320d5 tempest-VolumesImageMetadata-1829391205 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:16:36 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-8a176739-27a3-481f-9e76-3e5a1a0320d5 tempest-VolumesImageMetadata-1829391205 None] Deleted volume successfully. Apr 28 19:16:36 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8a176739-27a3-481f-9e76-3e5a1a0320d5 tempest-VolumesImageMetadata-1829391205 None] Lock "cinder-da5e22f8-9ffa-49ab-98f6-4b8db4dd8d6a-delete_volume" released by "delete_volume" :: held 4.576s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:16:36 devstack sudo[87203]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f5640110-40cc-4bf1-98b4-c829c5007a26 tempest-VolumeRetypeWithoutMigrationTest-227321252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.932s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:36 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-f5640110-40cc-4bf1-98b4-c829c5007a26 tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:16:36 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-f5640110-40cc-4bf1-98b4-c829c5007a26 tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Retype volume completed successfully. Apr 28 19:16:36 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-bef1ce07-ab7b-4162-878a-90d6547127b8 tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Acquiring lock "cinder-21c80b65-0dae-40e7-b7b3-97e9e89e88ee-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:16:36 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-bef1ce07-ab7b-4162-878a-90d6547127b8 tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Lock "cinder-21c80b65-0dae-40e7-b7b3-97e9e89e88ee-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:16:37 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-bef1ce07-ab7b-4162-878a-90d6547127b8 tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Acquiring lock "cinder-quobyte-21c80b65-0dae-40e7-b7b3-97e9e89e88ee" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:16:37 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-bef1ce07-ab7b-4162-878a-90d6547127b8 tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Lock "cinder-quobyte-21c80b65-0dae-40e7-b7b3-97e9e89e88ee" acquired by "delete_volume" :: waited 0.033s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:16:37 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[733d049a-75dc-4440-b547-26ea73c44cd0]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:16:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bef1ce07-ab7b-4162-878a-90d6547127b8 tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-21c80b65-0dae-40e7-b7b3-97e9e89e88ee {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:37 devstack sudo[87213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-21c80b65-0dae-40e7-b7b3-97e9e89e88ee Apr 28 19:16:37 devstack sudo[87213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:37 devstack sudo[87206]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3984b873-36df-4ea5-a38e-8301bd2130a0 tempest-SnapshotsActionsTest-904821522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d 1073741824" returned: 0 in 1.570s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3984b873-36df-4ea5-a38e-8301bd2130a0 tempest-SnapshotsActionsTest-904821522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:37 devstack sudo[87215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d Apr 28 19:16:37 devstack sudo[87215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:38 devstack sudo[87213]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bef1ce07-ab7b-4162-878a-90d6547127b8 tempest-VolumeRetypeWithoutMigrationTest-227321252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-21c80b65-0dae-40e7-b7b3-97e9e89e88ee" returned: 0 in 1.302s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bef1ce07-ab7b-4162-878a-90d6547127b8 tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-21c80b65-0dae-40e7-b7b3-97e9e89e88ee {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:38 devstack sudo[87220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-21c80b65-0dae-40e7-b7b3-97e9e89e88ee Apr 28 19:16:38 devstack sudo[87220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:38 devstack sudo[87215]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3984b873-36df-4ea5-a38e-8301bd2130a0 tempest-SnapshotsActionsTest-904821522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d" returned: 0 in 1.199s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:38 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3984b873-36df-4ea5-a38e-8301bd2130a0 tempest-SnapshotsActionsTest-904821522 None] <== create_volume: return (2829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:16:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3984b873-36df-4ea5-a38e-8301bd2130a0 tempest-SnapshotsActionsTest-904821522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.832s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:16:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3984b873-36df-4ea5-a38e-8301bd2130a0 tempest-SnapshotsActionsTest-904821522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a7e56d7-87ae-41bc-9996-5c76afa2c7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da601bc0-f975-4bd3-8926-4b6098299f9d', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:16:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3984b873-36df-4ea5-a38e-8301bd2130a0 tempest-SnapshotsActionsTest-904821522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf59d497-3bfb-4fd4-a3a2-7e2731f56ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:16:38 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-3984b873-36df-4ea5-a38e-8301bd2130a0 tempest-SnapshotsActionsTest-904821522 None] Volume volume-da601bc0-f975-4bd3-8926-4b6098299f9d (da601bc0-f975-4bd3-8926-4b6098299f9d): created successfully Apr 28 19:16:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3984b873-36df-4ea5-a38e-8301bd2130a0 tempest-SnapshotsActionsTest-904821522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf59d497-3bfb-4fd4-a3a2-7e2731f56ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:16:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3984b873-36df-4ea5-a38e-8301bd2130a0 tempest-SnapshotsActionsTest-904821522 None] Flow 'volume_create_manager' (93e38019-ebd1-4203-a79e-5dcb91daf788) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:16:38 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-3984b873-36df-4ea5-a38e-8301bd2130a0 tempest-SnapshotsActionsTest-904821522 None] Created volume successfully. Apr 28 19:16:39 devstack sudo[87220]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bef1ce07-ab7b-4162-878a-90d6547127b8 tempest-VolumeRetypeWithoutMigrationTest-227321252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-21c80b65-0dae-40e7-b7b3-97e9e89e88ee" returned: 0 in 1.006s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c953fc29-880c-44fd-9cde-b8a2a5ef016e tempest-SnapshotsActionsTest-904821522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:16:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c953fc29-880c-44fd-9cde-b8a2a5ef016e tempest-SnapshotsActionsTest-904821522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:16:39 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-bef1ce07-ab7b-4162-878a-90d6547127b8 tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Lock "cinder-quobyte-21c80b65-0dae-40e7-b7b3-97e9e89e88ee" released by "delete_volume" :: held 2.370s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:16:39 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-c953fc29-880c-44fd-9cde-b8a2a5ef016e tempest-SnapshotsActionsTest-904821522 None] Creating offline snapshot 445eb71b-067e-4caa-af57-8763051e85fe of volume da601bc0-f975-4bd3-8926-4b6098299f9d {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 19:16:39 devstack cinder-volume[83863]: WARNING cinder.quota [None req-bef1ce07-ab7b-4162-878a-90d6547127b8 tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 28 19:16:39 devstack cinder-volume[83863]: WARNING cinder.quota [None req-bef1ce07-ab7b-4162-878a-90d6547127b8 tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 28 19:16:39 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3c17ab-2159-453b-8083-b9bfd718fc46]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:16:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c953fc29-880c-44fd-9cde-b8a2a5ef016e tempest-SnapshotsActionsTest-904821522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:39 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-bef1ce07-ab7b-4162-878a-90d6547127b8 tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Created reservations ['1180046a-7a41-42f8-b610-7cb7746c1d36', '11bb5b33-9c3f-489e-8e9f-dba7cd7c71ec', 'fb875f37-6b26-453a-a07d-736e8e26e4a6', '1c08b53a-57d2-4e71-8162-9770524fa282'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:16:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-bef1ce07-ab7b-4162-878a-90d6547127b8 tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:16:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-bef1ce07-ab7b-4162-878a-90d6547127b8 tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:16:39 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-bef1ce07-ab7b-4162-878a-90d6547127b8 tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:16:39 devstack sudo[87224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d Apr 28 19:16:39 devstack sudo[87224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:39 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-bef1ce07-ab7b-4162-878a-90d6547127b8 tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:16:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-bef1ce07-ab7b-4162-878a-90d6547127b8 tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:16:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bef1ce07-ab7b-4162-878a-90d6547127b8 tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:39 devstack sudo[87226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:16:39 devstack sudo[87226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:40 devstack sudo[87224]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c953fc29-880c-44fd-9cde-b8a2a5ef016e tempest-SnapshotsActionsTest-904821522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d" returned: 0 in 1.118s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c953fc29-880c-44fd-9cde-b8a2a5ef016e tempest-SnapshotsActionsTest-904821522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:40 devstack sudo[87233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe 1G Apr 28 19:16:40 devstack sudo[87233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:41 devstack sudo[87226]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bef1ce07-ab7b-4162-878a-90d6547127b8 tempest-VolumeRetypeWithoutMigrationTest-227321252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 1.353s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:41 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-bef1ce07-ab7b-4162-878a-90d6547127b8 tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:16:41 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-bef1ce07-ab7b-4162-878a-90d6547127b8 tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Deleted volume successfully. Apr 28 19:16:41 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-bef1ce07-ab7b-4162-878a-90d6547127b8 tempest-VolumeRetypeWithoutMigrationTest-227321252 None] Lock "cinder-21c80b65-0dae-40e7-b7b3-97e9e89e88ee-delete_volume" released by "delete_volume" :: held 4.209s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:16:41 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd145c4d-5800-41a2-9867-cf0a912e6097 tempest-AbsoluteLimitsTests-709183304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:16:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fd145c4d-5800-41a2-9867-cf0a912e6097 tempest-AbsoluteLimitsTests-709183304 None] Flow 'volume_create_manager' (12fcf595-9a59-44ff-9af0-a36cb4903b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:16:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fd145c4d-5800-41a2-9867-cf0a912e6097 tempest-AbsoluteLimitsTests-709183304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22d01add-ab94-4d69-8c1d-35905402deae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:16:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fd145c4d-5800-41a2-9867-cf0a912e6097 tempest-AbsoluteLimitsTests-709183304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22d01add-ab94-4d69-8c1d-35905402deae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1851521315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54a424bf-1d31-489f-907e-a8209dd86d2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d59daf04a4c492391c0cba06250e122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:16:41Z,use_quota=True,user_id='37a59dfaf2dd440085857ec1b309f2a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:16:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fd145c4d-5800-41a2-9867-cf0a912e6097 tempest-AbsoluteLimitsTests-709183304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea12d0b6-a6c1-458d-a02c-840ccdf3b0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:16:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fd145c4d-5800-41a2-9867-cf0a912e6097 tempest-AbsoluteLimitsTests-709183304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea12d0b6-a6c1-458d-a02c-840ccdf3b0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:16:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fd145c4d-5800-41a2-9867-cf0a912e6097 tempest-AbsoluteLimitsTests-709183304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (934e6e3e-35b2-4063-b84f-68ec9fe6d08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:16:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fd145c4d-5800-41a2-9867-cf0a912e6097 tempest-AbsoluteLimitsTests-709183304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (934e6e3e-35b2-4063-b84f-68ec9fe6d08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54a424bf-1d31-489f-907e-a8209dd86d2e', 'volume_name': 'volume-54a424bf-1d31-489f-907e-a8209dd86d2e', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:16:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fd145c4d-5800-41a2-9867-cf0a912e6097 tempest-AbsoluteLimitsTests-709183304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a62071b4-4c2f-4f06-b277-0cd37efa1878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:16:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fd145c4d-5800-41a2-9867-cf0a912e6097 tempest-AbsoluteLimitsTests-709183304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a62071b4-4c2f-4f06-b277-0cd37efa1878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:16:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fd145c4d-5800-41a2-9867-cf0a912e6097 tempest-AbsoluteLimitsTests-709183304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48bfd602-a142-4a55-8408-20ce8c6aa507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:16:41 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-fd145c4d-5800-41a2-9867-cf0a912e6097 tempest-AbsoluteLimitsTests-709183304 None] Volume 54a424bf-1d31-489f-907e-a8209dd86d2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54a424bf-1d31-489f-907e-a8209dd86d2e', 'volume_size': 1} Apr 28 19:16:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fd145c4d-5800-41a2-9867-cf0a912e6097 tempest-AbsoluteLimitsTests-709183304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:16:41 devstack sudo[87233]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c953fc29-880c-44fd-9cde-b8a2a5ef016e tempest-SnapshotsActionsTest-904821522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe 1G" returned: 0 in 1.191s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c953fc29-880c-44fd-9cde-b8a2a5ef016e tempest-SnapshotsActionsTest-904821522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da601bc0-f975-4bd3-8926-4b6098299f9d -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:41 devstack sudo[87245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da601bc0-f975-4bd3-8926-4b6098299f9d -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe Apr 28 19:16:41 devstack sudo[87245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:42 devstack sudo[87245]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c953fc29-880c-44fd-9cde-b8a2a5ef016e tempest-SnapshotsActionsTest-904821522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da601bc0-f975-4bd3-8926-4b6098299f9d -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe" returned: 0 in 0.708s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:42 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-c953fc29-880c-44fd-9cde-b8a2a5ef016e tempest-SnapshotsActionsTest-904821522 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe is being set with open permissions: ugo+rw Apr 28 19:16:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c953fc29-880c-44fd-9cde-b8a2a5ef016e tempest-SnapshotsActionsTest-904821522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:42 devstack sudo[87250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe Apr 28 19:16:42 devstack sudo[87250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:43 devstack sudo[87250]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c953fc29-880c-44fd-9cde-b8a2a5ef016e tempest-SnapshotsActionsTest-904821522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe" returned: 0 in 0.695s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c953fc29-880c-44fd-9cde-b8a2a5ef016e tempest-SnapshotsActionsTest-904821522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:43 devstack sudo[87254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.info Apr 28 19:16:43 devstack sudo[87254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:44 devstack sudo[87254]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c953fc29-880c-44fd-9cde-b8a2a5ef016e tempest-SnapshotsActionsTest-904821522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.info" returned: 0 in 0.880s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:44 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-c953fc29-880c-44fd-9cde-b8a2a5ef016e tempest-SnapshotsActionsTest-904821522 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.info is being set with open permissions: ugo+rw Apr 28 19:16:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c953fc29-880c-44fd-9cde-b8a2a5ef016e tempest-SnapshotsActionsTest-904821522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:44 devstack sudo[87284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.info Apr 28 19:16:44 devstack sudo[87284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:44 devstack sudo[87284]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c953fc29-880c-44fd-9cde-b8a2a5ef016e tempest-SnapshotsActionsTest-904821522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.info" returned: 0 in 0.648s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c953fc29-880c-44fd-9cde-b8a2a5ef016e tempest-SnapshotsActionsTest-904821522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.448s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:16:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fd145c4d-5800-41a2-9867-cf0a912e6097 tempest-AbsoluteLimitsTests-709183304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.344s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:16:44 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-fd145c4d-5800-41a2-9867-cf0a912e6097 tempest-AbsoluteLimitsTests-709183304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1851521315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54a424bf-1d31-489f-907e-a8209dd86d2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d59daf04a4c492391c0cba06250e122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:16:41Z,use_quota=True,user_id='37a59dfaf2dd440085857ec1b309f2a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:16:44 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-fd145c4d-5800-41a2-9867-cf0a912e6097 tempest-AbsoluteLimitsTests-709183304 None] Creating volume 54a424bf-1d31-489f-907e-a8209dd86d2e {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:16:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fd145c4d-5800-41a2-9867-cf0a912e6097 tempest-AbsoluteLimitsTests-709183304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:16:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fd145c4d-5800-41a2-9867-cf0a912e6097 tempest-AbsoluteLimitsTests-709183304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:16:44 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-fd145c4d-5800-41a2-9867-cf0a912e6097 tempest-AbsoluteLimitsTests-709183304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:16:44 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-fd145c4d-5800-41a2-9867-cf0a912e6097 tempest-AbsoluteLimitsTests-709183304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:16:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fd145c4d-5800-41a2-9867-cf0a912e6097 tempest-AbsoluteLimitsTests-709183304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:16:44 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-fd145c4d-5800-41a2-9867-cf0a912e6097 tempest-AbsoluteLimitsTests-709183304 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:16:44 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-fd145c4d-5800-41a2-9867-cf0a912e6097 tempest-AbsoluteLimitsTests-709183304 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:16:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fd145c4d-5800-41a2-9867-cf0a912e6097 tempest-AbsoluteLimitsTests-709183304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-54a424bf-1d31-489f-907e-a8209dd86d2e 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:44 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-c953fc29-880c-44fd-9cde-b8a2a5ef016e tempest-SnapshotsActionsTest-904821522 None] Create snapshot completed successfully Apr 28 19:16:44 devstack sudo[87287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-54a424bf-1d31-489f-907e-a8209dd86d2e 1073741824 Apr 28 19:16:44 devstack sudo[87287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:46 devstack sudo[87287]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fd145c4d-5800-41a2-9867-cf0a912e6097 tempest-AbsoluteLimitsTests-709183304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-54a424bf-1d31-489f-907e-a8209dd86d2e 1073741824" returned: 0 in 1.113s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fd145c4d-5800-41a2-9867-cf0a912e6097 tempest-AbsoluteLimitsTests-709183304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-54a424bf-1d31-489f-907e-a8209dd86d2e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:46 devstack sudo[87299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-54a424bf-1d31-489f-907e-a8209dd86d2e Apr 28 19:16:46 devstack sudo[87299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:46 devstack sudo[87299]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fd145c4d-5800-41a2-9867-cf0a912e6097 tempest-AbsoluteLimitsTests-709183304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-54a424bf-1d31-489f-907e-a8209dd86d2e" returned: 0 in 0.781s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:46 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-fd145c4d-5800-41a2-9867-cf0a912e6097 tempest-AbsoluteLimitsTests-709183304 None] <== create_volume: return (1948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:16:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fd145c4d-5800-41a2-9867-cf0a912e6097 tempest-AbsoluteLimitsTests-709183304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.952s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:16:46 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fd145c4d-5800-41a2-9867-cf0a912e6097 tempest-AbsoluteLimitsTests-709183304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48bfd602-a142-4a55-8408-20ce8c6aa507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54a424bf-1d31-489f-907e-a8209dd86d2e', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:16:46 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fd145c4d-5800-41a2-9867-cf0a912e6097 tempest-AbsoluteLimitsTests-709183304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3095640-cf81-4dd7-905f-2160b3541407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:16:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2666806d-a0d1-46e5-93d6-47c2fff3205a tempest-SnapshotsActionsTest-904821522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:16:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2666806d-a0d1-46e5-93d6-47c2fff3205a tempest-SnapshotsActionsTest-904821522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:16:46 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-fd145c4d-5800-41a2-9867-cf0a912e6097 tempest-AbsoluteLimitsTests-709183304 None] Volume volume-54a424bf-1d31-489f-907e-a8209dd86d2e (54a424bf-1d31-489f-907e-a8209dd86d2e): created successfully Apr 28 19:16:46 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fd145c4d-5800-41a2-9867-cf0a912e6097 tempest-AbsoluteLimitsTests-709183304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3095640-cf81-4dd7-905f-2160b3541407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:16:46 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fd145c4d-5800-41a2-9867-cf0a912e6097 tempest-AbsoluteLimitsTests-709183304 None] Flow 'volume_create_manager' (12fcf595-9a59-44ff-9af0-a36cb4903b3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:16:46 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-2666806d-a0d1-46e5-93d6-47c2fff3205a tempest-SnapshotsActionsTest-904821522 None] Creating offline snapshot bdb30d92-1943-4d5a-8273-14292156c6f8 of volume da601bc0-f975-4bd3-8926-4b6098299f9d {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 19:16:46 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-fd145c4d-5800-41a2-9867-cf0a912e6097 tempest-AbsoluteLimitsTests-709183304 None] Created volume successfully. Apr 28 19:16:46 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45a4a22-3ffc-4603-ada7-ba033ab4f0c3]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:16:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2666806d-a0d1-46e5-93d6-47c2fff3205a tempest-SnapshotsActionsTest-904821522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:47 devstack sudo[87302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe Apr 28 19:16:47 devstack sudo[87302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:48 devstack sudo[87302]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2666806d-a0d1-46e5-93d6-47c2fff3205a tempest-SnapshotsActionsTest-904821522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe" returned: 0 in 1.054s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:48 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-2666806d-a0d1-46e5-93d6-47c2fff3205a tempest-SnapshotsActionsTest-904821522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da601bc0-f975-4bd3-8926-4b6098299f9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:16:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2666806d-a0d1-46e5-93d6-47c2fff3205a tempest-SnapshotsActionsTest-904821522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.bdb30d92-1943-4d5a-8273-14292156c6f8 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:48 devstack sudo[87318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.bdb30d92-1943-4d5a-8273-14292156c6f8 1G Apr 28 19:16:48 devstack sudo[87318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:48 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-82953a27-bc22-4f97-8e07-d1bb07090641 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:16:48 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-82953a27-bc22-4f97-8e07-d1bb07090641 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Flow 'volume_create_manager' (1693858e-e522-4bb6-9a6f-90565410058f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:16:48 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-82953a27-bc22-4f97-8e07-d1bb07090641 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cf90c74-1d7e-4284-8a49-1912aa086591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:16:48 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-af2e5698-dc16-4dbd-b0cc-f4fc49f33884 tempest-AbsoluteLimitsTests-709183304 None] Acquiring lock "cinder-54a424bf-1d31-489f-907e-a8209dd86d2e-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:16:48 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-82953a27-bc22-4f97-8e07-d1bb07090641 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cf90c74-1d7e-4284-8a49-1912aa086591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-290148195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5329d833-0e77-4f52-8103-8649501f6dc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1efd43435ac44f4b3f468a5fb737afb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:16:48Z,use_quota=True,user_id='a4e58a57c860430ca977166208178d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:16:48 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-82953a27-bc22-4f97-8e07-d1bb07090641 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8be55bf-b9b7-4961-8c29-dab2deb9735b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:16:48 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-82953a27-bc22-4f97-8e07-d1bb07090641 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8be55bf-b9b7-4961-8c29-dab2deb9735b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:16:48 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-82953a27-bc22-4f97-8e07-d1bb07090641 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df035015-04ec-4abc-9b47-d60c6c394dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:16:48 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-82953a27-bc22-4f97-8e07-d1bb07090641 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df035015-04ec-4abc-9b47-d60c6c394dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5329d833-0e77-4f52-8103-8649501f6dc5', 'volume_name': 'volume-5329d833-0e77-4f52-8103-8649501f6dc5', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:16:48 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-82953a27-bc22-4f97-8e07-d1bb07090641 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c291e02-e619-4f40-b286-9471346e022e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:16:48 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-82953a27-bc22-4f97-8e07-d1bb07090641 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c291e02-e619-4f40-b286-9471346e022e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:16:48 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-82953a27-bc22-4f97-8e07-d1bb07090641 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58d43c4d-14f9-43ac-b3c6-a8585f12f5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:16:48 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-82953a27-bc22-4f97-8e07-d1bb07090641 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Volume 5329d833-0e77-4f52-8103-8649501f6dc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5329d833-0e77-4f52-8103-8649501f6dc5', 'volume_size': 1} Apr 28 19:16:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-82953a27-bc22-4f97-8e07-d1bb07090641 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:16:48 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-af2e5698-dc16-4dbd-b0cc-f4fc49f33884 tempest-AbsoluteLimitsTests-709183304 None] Lock "cinder-54a424bf-1d31-489f-907e-a8209dd86d2e-delete_volume" acquired by "delete_volume" :: waited 0.107s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:16:48 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-af2e5698-dc16-4dbd-b0cc-f4fc49f33884 tempest-AbsoluteLimitsTests-709183304 None] Acquiring lock "cinder-quobyte-54a424bf-1d31-489f-907e-a8209dd86d2e" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:16:48 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-af2e5698-dc16-4dbd-b0cc-f4fc49f33884 tempest-AbsoluteLimitsTests-709183304 None] Lock "cinder-quobyte-54a424bf-1d31-489f-907e-a8209dd86d2e" acquired by "delete_volume" :: waited 0.039s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:16:48 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1d6dc2-bee6-4302-afe8-6aac74233dca]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:16:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-af2e5698-dc16-4dbd-b0cc-f4fc49f33884 tempest-AbsoluteLimitsTests-709183304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-54a424bf-1d31-489f-907e-a8209dd86d2e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:48 devstack sudo[87334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-54a424bf-1d31-489f-907e-a8209dd86d2e Apr 28 19:16:48 devstack sudo[87334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:49 devstack sudo[87318]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2666806d-a0d1-46e5-93d6-47c2fff3205a tempest-SnapshotsActionsTest-904821522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.bdb30d92-1943-4d5a-8273-14292156c6f8 1G" returned: 0 in 1.087s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2666806d-a0d1-46e5-93d6-47c2fff3205a tempest-SnapshotsActionsTest-904821522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.bdb30d92-1943-4d5a-8273-14292156c6f8 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:49 devstack sudo[87340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.bdb30d92-1943-4d5a-8273-14292156c6f8 Apr 28 19:16:49 devstack sudo[87340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:49 devstack sudo[87334]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-af2e5698-dc16-4dbd-b0cc-f4fc49f33884 tempest-AbsoluteLimitsTests-709183304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-54a424bf-1d31-489f-907e-a8209dd86d2e" returned: 0 in 0.790s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-af2e5698-dc16-4dbd-b0cc-f4fc49f33884 tempest-AbsoluteLimitsTests-709183304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-54a424bf-1d31-489f-907e-a8209dd86d2e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:49 devstack sudo[87345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-54a424bf-1d31-489f-907e-a8209dd86d2e Apr 28 19:16:49 devstack sudo[87345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:49 devstack sudo[87340]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2666806d-a0d1-46e5-93d6-47c2fff3205a tempest-SnapshotsActionsTest-904821522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.bdb30d92-1943-4d5a-8273-14292156c6f8" returned: 0 in 0.761s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:49 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-2666806d-a0d1-46e5-93d6-47c2fff3205a tempest-SnapshotsActionsTest-904821522 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.bdb30d92-1943-4d5a-8273-14292156c6f8 is being set with open permissions: ugo+rw Apr 28 19:16:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2666806d-a0d1-46e5-93d6-47c2fff3205a tempest-SnapshotsActionsTest-904821522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.bdb30d92-1943-4d5a-8273-14292156c6f8 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:49 devstack sudo[87353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.bdb30d92-1943-4d5a-8273-14292156c6f8 Apr 28 19:16:49 devstack sudo[87353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:50 devstack sudo[87345]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-af2e5698-dc16-4dbd-b0cc-f4fc49f33884 tempest-AbsoluteLimitsTests-709183304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-54a424bf-1d31-489f-907e-a8209dd86d2e" returned: 0 in 0.709s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:50 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-af2e5698-dc16-4dbd-b0cc-f4fc49f33884 tempest-AbsoluteLimitsTests-709183304 None] Lock "cinder-quobyte-54a424bf-1d31-489f-907e-a8209dd86d2e" released by "delete_volume" :: held 1.561s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:16:50 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-af2e5698-dc16-4dbd-b0cc-f4fc49f33884 tempest-AbsoluteLimitsTests-709183304 None] Created reservations ['5e93bed9-6da9-47f7-98c9-8fd2a3d0e2af', '356aae1d-34f0-4c71-a138-75ba46773500', 'ca62d520-0853-4958-a42b-375359c01810', '41659257-e4be-4864-be7a-558793baab7e'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:16:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-af2e5698-dc16-4dbd-b0cc-f4fc49f33884 tempest-AbsoluteLimitsTests-709183304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:16:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-af2e5698-dc16-4dbd-b0cc-f4fc49f33884 tempest-AbsoluteLimitsTests-709183304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:16:50 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-af2e5698-dc16-4dbd-b0cc-f4fc49f33884 tempest-AbsoluteLimitsTests-709183304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:16:50 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-af2e5698-dc16-4dbd-b0cc-f4fc49f33884 tempest-AbsoluteLimitsTests-709183304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:16:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-af2e5698-dc16-4dbd-b0cc-f4fc49f33884 tempest-AbsoluteLimitsTests-709183304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:16:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-af2e5698-dc16-4dbd-b0cc-f4fc49f33884 tempest-AbsoluteLimitsTests-709183304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:50 devstack sudo[87357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:16:50 devstack sudo[87357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:50 devstack sudo[87353]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2666806d-a0d1-46e5-93d6-47c2fff3205a tempest-SnapshotsActionsTest-904821522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.bdb30d92-1943-4d5a-8273-14292156c6f8" returned: 0 in 0.678s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2666806d-a0d1-46e5-93d6-47c2fff3205a tempest-SnapshotsActionsTest-904821522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.726s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:16:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-82953a27-bc22-4f97-8e07-d1bb07090641 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.078s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:16:50 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-82953a27-bc22-4f97-8e07-d1bb07090641 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-290148195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5329d833-0e77-4f52-8103-8649501f6dc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1efd43435ac44f4b3f468a5fb737afb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:16:48Z,use_quota=True,user_id='a4e58a57c860430ca977166208178d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:16:50 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-82953a27-bc22-4f97-8e07-d1bb07090641 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Creating volume 5329d833-0e77-4f52-8103-8649501f6dc5 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:16:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-82953a27-bc22-4f97-8e07-d1bb07090641 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:16:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-82953a27-bc22-4f97-8e07-d1bb07090641 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:16:50 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-82953a27-bc22-4f97-8e07-d1bb07090641 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:16:50 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-82953a27-bc22-4f97-8e07-d1bb07090641 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:16:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-82953a27-bc22-4f97-8e07-d1bb07090641 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:16:50 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-82953a27-bc22-4f97-8e07-d1bb07090641 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:16:50 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-82953a27-bc22-4f97-8e07-d1bb07090641 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:16:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-82953a27-bc22-4f97-8e07-d1bb07090641 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5329d833-0e77-4f52-8103-8649501f6dc5 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:50 devstack sudo[87363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5329d833-0e77-4f52-8103-8649501f6dc5 1073741824 Apr 28 19:16:50 devstack sudo[87363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:50 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-2666806d-a0d1-46e5-93d6-47c2fff3205a tempest-SnapshotsActionsTest-904821522 None] Create snapshot completed successfully Apr 28 19:16:51 devstack sudo[87357]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-af2e5698-dc16-4dbd-b0cc-f4fc49f33884 tempest-AbsoluteLimitsTests-709183304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.736s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:51 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-af2e5698-dc16-4dbd-b0cc-f4fc49f33884 tempest-AbsoluteLimitsTests-709183304 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:16:51 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-af2e5698-dc16-4dbd-b0cc-f4fc49f33884 tempest-AbsoluteLimitsTests-709183304 None] Deleted volume successfully. Apr 28 19:16:51 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-af2e5698-dc16-4dbd-b0cc-f4fc49f33884 tempest-AbsoluteLimitsTests-709183304 None] Lock "cinder-54a424bf-1d31-489f-907e-a8209dd86d2e-delete_volume" released by "delete_volume" :: held 2.542s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:16:51 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-81ff47b5-1756-4105-95e8-896097a322a2 tempest-SnapshotsActionsTest-189624283 None] Acquiring lock "cinder-bdb30d92-1943-4d5a-8273-14292156c6f8-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:16:51 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-81ff47b5-1756-4105-95e8-896097a322a2 tempest-SnapshotsActionsTest-189624283 None] Lock "cinder-bdb30d92-1943-4d5a-8273-14292156c6f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:16:51 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-81ff47b5-1756-4105-95e8-896097a322a2 tempest-SnapshotsActionsTest-189624283 None] Acquiring lock "cinder-quobyte-da601bc0-f975-4bd3-8926-4b6098299f9d" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:16:51 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-81ff47b5-1756-4105-95e8-896097a322a2 tempest-SnapshotsActionsTest-189624283 None] Lock "cinder-quobyte-da601bc0-f975-4bd3-8926-4b6098299f9d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:16:51 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-81ff47b5-1756-4105-95e8-896097a322a2 tempest-SnapshotsActionsTest-189624283 None] Acquiring lock "cinder-quobyte-bdb30d92-1943-4d5a-8273-14292156c6f8" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:16:51 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-81ff47b5-1756-4105-95e8-896097a322a2 tempest-SnapshotsActionsTest-189624283 None] Lock "cinder-quobyte-bdb30d92-1943-4d5a-8273-14292156c6f8" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:16:51 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-81ff47b5-1756-4105-95e8-896097a322a2 tempest-SnapshotsActionsTest-189624283 None] Deleting offline snapshot bdb30d92-1943-4d5a-8273-14292156c6f8 of volume da601bc0-f975-4bd3-8926-4b6098299f9d {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 19:16:51 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-81ff47b5-1756-4105-95e8-896097a322a2 tempest-SnapshotsActionsTest-189624283 None] snapshot_file for this snap is: volume-da601bc0-f975-4bd3-8926-4b6098299f9d.bdb30d92-1943-4d5a-8273-14292156c6f8 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 19:16:51 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[756d0632-3a13-4f3c-8ae5-e0956203bdf9]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:16:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-81ff47b5-1756-4105-95e8-896097a322a2 tempest-SnapshotsActionsTest-189624283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.bdb30d92-1943-4d5a-8273-14292156c6f8 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:51 devstack sudo[87371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.bdb30d92-1943-4d5a-8273-14292156c6f8 Apr 28 19:16:51 devstack sudo[87371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:51 devstack sudo[87363]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-82953a27-bc22-4f97-8e07-d1bb07090641 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5329d833-0e77-4f52-8103-8649501f6dc5 1073741824" returned: 0 in 1.001s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-82953a27-bc22-4f97-8e07-d1bb07090641 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5329d833-0e77-4f52-8103-8649501f6dc5 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:51 devstack sudo[87373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5329d833-0e77-4f52-8103-8649501f6dc5 Apr 28 19:16:51 devstack sudo[87373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:52 devstack sudo[87371]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-81ff47b5-1756-4105-95e8-896097a322a2 tempest-SnapshotsActionsTest-189624283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.bdb30d92-1943-4d5a-8273-14292156c6f8" returned: 0 in 0.788s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:52 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-81ff47b5-1756-4105-95e8-896097a322a2 tempest-SnapshotsActionsTest-189624283 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da601bc0-f975-4bd3-8926-4b6098299f9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:16:52 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6408fa23-6e2a-4294-af1d-a3927f7a0cbf]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:16:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-81ff47b5-1756-4105-95e8-896097a322a2 tempest-SnapshotsActionsTest-189624283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:52 devstack sudo[87379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe Apr 28 19:16:52 devstack sudo[87379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:52 devstack sudo[87373]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-82953a27-bc22-4f97-8e07-d1bb07090641 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5329d833-0e77-4f52-8103-8649501f6dc5" returned: 0 in 0.708s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:52 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-82953a27-bc22-4f97-8e07-d1bb07090641 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] <== create_volume: return (1767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:16:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-82953a27-bc22-4f97-8e07-d1bb07090641 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:16:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-82953a27-bc22-4f97-8e07-d1bb07090641 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58d43c4d-14f9-43ac-b3c6-a8585f12f5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5329d833-0e77-4f52-8103-8649501f6dc5', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:16:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-82953a27-bc22-4f97-8e07-d1bb07090641 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62cad819-050e-4518-a880-521648c5db77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:16:52 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-82953a27-bc22-4f97-8e07-d1bb07090641 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Volume volume-5329d833-0e77-4f52-8103-8649501f6dc5 (5329d833-0e77-4f52-8103-8649501f6dc5): created successfully Apr 28 19:16:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-82953a27-bc22-4f97-8e07-d1bb07090641 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62cad819-050e-4518-a880-521648c5db77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:16:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-82953a27-bc22-4f97-8e07-d1bb07090641 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Flow 'volume_create_manager' (1693858e-e522-4bb6-9a6f-90565410058f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:16:52 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-82953a27-bc22-4f97-8e07-d1bb07090641 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Created volume successfully. Apr 28 19:16:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1a31f3dc-da80-41e3-b11b-1ca8cceaa419 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:16:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1a31f3dc-da80-41e3-b11b-1ca8cceaa419 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:16:52 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-1a31f3dc-da80-41e3-b11b-1ca8cceaa419 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Creating offline snapshot 9680061b-2f16-422e-911b-3d80d4a35edd of volume 5329d833-0e77-4f52-8103-8649501f6dc5 {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 19:16:52 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c6ec6e-89b0-411a-b777-8876d4eefb65]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:16:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1a31f3dc-da80-41e3-b11b-1ca8cceaa419 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5329d833-0e77-4f52-8103-8649501f6dc5 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:52 devstack sudo[87382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5329d833-0e77-4f52-8103-8649501f6dc5 Apr 28 19:16:52 devstack sudo[87382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:53 devstack sudo[87379]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-81ff47b5-1756-4105-95e8-896097a322a2 tempest-SnapshotsActionsTest-189624283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe" returned: 0 in 0.961s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:53 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-81ff47b5-1756-4105-95e8-896097a322a2 tempest-SnapshotsActionsTest-189624283 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da601bc0-f975-4bd3-8926-4b6098299f9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:16:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-81ff47b5-1756-4105-95e8-896097a322a2 tempest-SnapshotsActionsTest-189624283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.bdb30d92-1943-4d5a-8273-14292156c6f8 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:53 devstack sudo[87387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.bdb30d92-1943-4d5a-8273-14292156c6f8 Apr 28 19:16:53 devstack sudo[87387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:53 devstack sudo[87382]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1a31f3dc-da80-41e3-b11b-1ca8cceaa419 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5329d833-0e77-4f52-8103-8649501f6dc5" returned: 0 in 0.864s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1a31f3dc-da80-41e3-b11b-1ca8cceaa419 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5329d833-0e77-4f52-8103-8649501f6dc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5329d833-0e77-4f52-8103-8649501f6dc5.9680061b-2f16-422e-911b-3d80d4a35edd 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:53 devstack sudo[87392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5329d833-0e77-4f52-8103-8649501f6dc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5329d833-0e77-4f52-8103-8649501f6dc5.9680061b-2f16-422e-911b-3d80d4a35edd 1G Apr 28 19:16:53 devstack sudo[87392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:54 devstack sudo[87387]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-81ff47b5-1756-4105-95e8-896097a322a2 tempest-SnapshotsActionsTest-189624283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.bdb30d92-1943-4d5a-8273-14292156c6f8" returned: 0 in 0.937s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-81ff47b5-1756-4105-95e8-896097a322a2 tempest-SnapshotsActionsTest-189624283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.bdb30d92-1943-4d5a-8273-14292156c6f8 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:54 devstack sudo[87398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.bdb30d92-1943-4d5a-8273-14292156c6f8 Apr 28 19:16:54 devstack sudo[87398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:54 devstack sudo[87392]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1a31f3dc-da80-41e3-b11b-1ca8cceaa419 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5329d833-0e77-4f52-8103-8649501f6dc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5329d833-0e77-4f52-8103-8649501f6dc5.9680061b-2f16-422e-911b-3d80d4a35edd 1G" returned: 0 in 0.951s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1a31f3dc-da80-41e3-b11b-1ca8cceaa419 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5329d833-0e77-4f52-8103-8649501f6dc5 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5329d833-0e77-4f52-8103-8649501f6dc5.9680061b-2f16-422e-911b-3d80d4a35edd {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:54 devstack sudo[87404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5329d833-0e77-4f52-8103-8649501f6dc5 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5329d833-0e77-4f52-8103-8649501f6dc5.9680061b-2f16-422e-911b-3d80d4a35edd Apr 28 19:16:54 devstack sudo[87404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:54 devstack sudo[87398]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-81ff47b5-1756-4105-95e8-896097a322a2 tempest-SnapshotsActionsTest-189624283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.bdb30d92-1943-4d5a-8273-14292156c6f8" returned: 0 in 0.840s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:55 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-81ff47b5-1756-4105-95e8-896097a322a2 tempest-SnapshotsActionsTest-189624283 None] Lock "cinder-quobyte-bdb30d92-1943-4d5a-8273-14292156c6f8" released by "_delete_snapshot" :: held 3.664s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:16:55 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-81ff47b5-1756-4105-95e8-896097a322a2 tempest-SnapshotsActionsTest-189624283 None] Lock "cinder-quobyte-da601bc0-f975-4bd3-8926-4b6098299f9d" released by "delete_snapshot" :: held 3.693s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:16:55 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-81ff47b5-1756-4105-95e8-896097a322a2 tempest-SnapshotsActionsTest-189624283 None] Created reservations ['c59d27a6-e075-4fbc-bfdc-ea7346c67855', '67e849fe-2536-4093-9998-84111fd85f9c', '39dd0f2b-f5cb-483f-91bd-c1d6d56730a1', '7e3df591-f0a8-4416-82dc-a22ca5d08a2c'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:16:55 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-81ff47b5-1756-4105-95e8-896097a322a2 tempest-SnapshotsActionsTest-189624283 None] Delete snapshot completed successfully. Apr 28 19:16:55 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-81ff47b5-1756-4105-95e8-896097a322a2 tempest-SnapshotsActionsTest-189624283 None] Lock "cinder-bdb30d92-1943-4d5a-8273-14292156c6f8-delete_snapshot" released by "delete_snapshot" :: held 3.883s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:16:55 devstack sudo[87404]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1a31f3dc-da80-41e3-b11b-1ca8cceaa419 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5329d833-0e77-4f52-8103-8649501f6dc5 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5329d833-0e77-4f52-8103-8649501f6dc5.9680061b-2f16-422e-911b-3d80d4a35edd" returned: 0 in 1.201s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:55 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-1a31f3dc-da80-41e3-b11b-1ca8cceaa419 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5329d833-0e77-4f52-8103-8649501f6dc5.9680061b-2f16-422e-911b-3d80d4a35edd is being set with open permissions: ugo+rw Apr 28 19:16:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1a31f3dc-da80-41e3-b11b-1ca8cceaa419 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5329d833-0e77-4f52-8103-8649501f6dc5.9680061b-2f16-422e-911b-3d80d4a35edd {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:55 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dd1e29a-7f90-406d-b454-802842a3477c tempest-VolumesCloneNegativeTest-2134409161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:16:55 devstack sudo[87410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5329d833-0e77-4f52-8103-8649501f6dc5.9680061b-2f16-422e-911b-3d80d4a35edd Apr 28 19:16:55 devstack sudo[87410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2dd1e29a-7f90-406d-b454-802842a3477c tempest-VolumesCloneNegativeTest-2134409161 None] Flow 'volume_create_manager' (5b1181c3-c836-492d-9318-566b2c11f593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:16:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2dd1e29a-7f90-406d-b454-802842a3477c tempest-VolumesCloneNegativeTest-2134409161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d1828bb-d0da-41c8-82e3-f7990f9aecb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:16:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2dd1e29a-7f90-406d-b454-802842a3477c tempest-VolumesCloneNegativeTest-2134409161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d1828bb-d0da-41c8-82e3-f7990f9aecb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1034106179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbb48314-53c8-4e07-89cb-f67023b75fac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d05f5c6e4cad4290b7bf1785b5da7f4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:16:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:16:56Z,use_quota=True,user_id='57448ef1eaef4dbd9022778338b69c7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:16:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2dd1e29a-7f90-406d-b454-802842a3477c tempest-VolumesCloneNegativeTest-2134409161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b63dfe7-20e4-414c-91a2-676b730ee8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:16:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2dd1e29a-7f90-406d-b454-802842a3477c tempest-VolumesCloneNegativeTest-2134409161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b63dfe7-20e4-414c-91a2-676b730ee8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:16:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2dd1e29a-7f90-406d-b454-802842a3477c tempest-VolumesCloneNegativeTest-2134409161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d92a2535-03f0-4ab3-81c3-1f3ec95f5d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:16:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2dd1e29a-7f90-406d-b454-802842a3477c tempest-VolumesCloneNegativeTest-2134409161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d92a2535-03f0-4ab3-81c3-1f3ec95f5d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbb48314-53c8-4e07-89cb-f67023b75fac', 'volume_name': 'volume-dbb48314-53c8-4e07-89cb-f67023b75fac', 'volume_size': 2}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:16:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2dd1e29a-7f90-406d-b454-802842a3477c tempest-VolumesCloneNegativeTest-2134409161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9dcc47e-f716-4811-a302-ef22f2248881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:16:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2dd1e29a-7f90-406d-b454-802842a3477c tempest-VolumesCloneNegativeTest-2134409161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9dcc47e-f716-4811-a302-ef22f2248881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:16:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2dd1e29a-7f90-406d-b454-802842a3477c tempest-VolumesCloneNegativeTest-2134409161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3403e8ed-1d00-423a-8f30-0f316c1b2b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:16:56 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-2dd1e29a-7f90-406d-b454-802842a3477c tempest-VolumesCloneNegativeTest-2134409161 None] Volume dbb48314-53c8-4e07-89cb-f67023b75fac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbb48314-53c8-4e07-89cb-f67023b75fac', 'volume_size': 2} Apr 28 19:16:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2dd1e29a-7f90-406d-b454-802842a3477c tempest-VolumesCloneNegativeTest-2134409161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:16:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d9fd19ec-3dd0-48af-a40c-67c873ab0a0f tempest-SnapshotsActionsTest-904821522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:16:56 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [req-9435076a-de3c-4360-8781-199bd21b619e req-408b7861-5dcc-4323-87db-d2429c945a04 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:16:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-9435076a-de3c-4360-8781-199bd21b619e req-408b7861-5dcc-4323-87db-d2429c945a04 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Flow 'volume_create_manager' (ab2e8a80-2081-4df6-9437-37cd77fe51c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:16:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-9435076a-de3c-4360-8781-199bd21b619e req-408b7861-5dcc-4323-87db-d2429c945a04 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (927d23e2-2270-4a73-a977-6fd742bcc14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:16:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-9435076a-de3c-4360-8781-199bd21b619e req-408b7861-5dcc-4323-87db-d2429c945a04 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (927d23e2-2270-4a73-a977-6fd742bcc14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:16:56Z,deleted=False,deleted_at=None,display_description='',display_name='a2522946-0c26-4a72-a97a-381b6bc68da5-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c07d1a36-dd01-4e4f-84b2-ad728bd12c58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc1948fb33ee4623afe433b535ba7283',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:16:57Z,use_quota=True,user_id='76eae2fdd3344aa28f0bb12673b1cb44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:16:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-9435076a-de3c-4360-8781-199bd21b619e req-408b7861-5dcc-4323-87db-d2429c945a04 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b5dbfa2-e153-4ff1-be29-cafd475b3914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:16:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-9435076a-de3c-4360-8781-199bd21b619e req-408b7861-5dcc-4323-87db-d2429c945a04 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b5dbfa2-e153-4ff1-be29-cafd475b3914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:16:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-9435076a-de3c-4360-8781-199bd21b619e req-408b7861-5dcc-4323-87db-d2429c945a04 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a793b682-7427-48b5-b542-1ce84f84e662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:16:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-9435076a-de3c-4360-8781-199bd21b619e req-408b7861-5dcc-4323-87db-d2429c945a04 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a793b682-7427-48b5-b542-1ce84f84e662) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c07d1a36-dd01-4e4f-84b2-ad728bd12c58', 'volume_name': 'volume-c07d1a36-dd01-4e4f-84b2-ad728bd12c58', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:16:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-9435076a-de3c-4360-8781-199bd21b619e req-408b7861-5dcc-4323-87db-d2429c945a04 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f24c9c6-fdf0-4d73-aa4d-4932461e5ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:16:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-9435076a-de3c-4360-8781-199bd21b619e req-408b7861-5dcc-4323-87db-d2429c945a04 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f24c9c6-fdf0-4d73-aa4d-4932461e5ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:16:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-9435076a-de3c-4360-8781-199bd21b619e req-408b7861-5dcc-4323-87db-d2429c945a04 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (298f4f5b-a0e0-4223-be04-c67aea4ed23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:16:56 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [req-9435076a-de3c-4360-8781-199bd21b619e req-408b7861-5dcc-4323-87db-d2429c945a04 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Volume c07d1a36-dd01-4e4f-84b2-ad728bd12c58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c07d1a36-dd01-4e4f-84b2-ad728bd12c58', 'volume_size': 1} Apr 28 19:16:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-9435076a-de3c-4360-8781-199bd21b619e req-408b7861-5dcc-4323-87db-d2429c945a04 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:16:56 devstack sudo[87410]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1a31f3dc-da80-41e3-b11b-1ca8cceaa419 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5329d833-0e77-4f52-8103-8649501f6dc5.9680061b-2f16-422e-911b-3d80d4a35edd" returned: 0 in 1.085s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1a31f3dc-da80-41e3-b11b-1ca8cceaa419 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5329d833-0e77-4f52-8103-8649501f6dc5.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:57 devstack sudo[87413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5329d833-0e77-4f52-8103-8649501f6dc5.info Apr 28 19:16:57 devstack sudo[87413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:57 devstack sudo[87413]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1a31f3dc-da80-41e3-b11b-1ca8cceaa419 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5329d833-0e77-4f52-8103-8649501f6dc5.info" returned: 0 in 0.647s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:57 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-1a31f3dc-da80-41e3-b11b-1ca8cceaa419 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5329d833-0e77-4f52-8103-8649501f6dc5.info is being set with open permissions: ugo+rw Apr 28 19:16:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1a31f3dc-da80-41e3-b11b-1ca8cceaa419 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5329d833-0e77-4f52-8103-8649501f6dc5.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:57 devstack sudo[87418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5329d833-0e77-4f52-8103-8649501f6dc5.info Apr 28 19:16:57 devstack sudo[87418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:58 devstack sudo[87418]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1a31f3dc-da80-41e3-b11b-1ca8cceaa419 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5329d833-0e77-4f52-8103-8649501f6dc5.info" returned: 0 in 0.591s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1a31f3dc-da80-41e3-b11b-1ca8cceaa419 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.467s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:16:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2dd1e29a-7f90-406d-b454-802842a3477c tempest-VolumesCloneNegativeTest-2134409161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.034s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:16:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2dd1e29a-7f90-406d-b454-802842a3477c tempest-VolumesCloneNegativeTest-2134409161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1034106179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbb48314-53c8-4e07-89cb-f67023b75fac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d05f5c6e4cad4290b7bf1785b5da7f4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:16:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:16:56Z,use_quota=True,user_id='57448ef1eaef4dbd9022778338b69c7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:16:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-2dd1e29a-7f90-406d-b454-802842a3477c tempest-VolumesCloneNegativeTest-2134409161 None] Creating volume dbb48314-53c8-4e07-89cb-f67023b75fac {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:16:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2dd1e29a-7f90-406d-b454-802842a3477c tempest-VolumesCloneNegativeTest-2134409161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:16:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2dd1e29a-7f90-406d-b454-802842a3477c tempest-VolumesCloneNegativeTest-2134409161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:16:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2dd1e29a-7f90-406d-b454-802842a3477c tempest-VolumesCloneNegativeTest-2134409161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:16:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2dd1e29a-7f90-406d-b454-802842a3477c tempest-VolumesCloneNegativeTest-2134409161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:16:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2dd1e29a-7f90-406d-b454-802842a3477c tempest-VolumesCloneNegativeTest-2134409161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:16:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2dd1e29a-7f90-406d-b454-802842a3477c tempest-VolumesCloneNegativeTest-2134409161 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:16:58 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-2dd1e29a-7f90-406d-b454-802842a3477c tempest-VolumesCloneNegativeTest-2134409161 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:16:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2dd1e29a-7f90-406d-b454-802842a3477c tempest-VolumesCloneNegativeTest-2134409161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-dbb48314-53c8-4e07-89cb-f67023b75fac 2147483648 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:58 devstack sudo[87421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-dbb48314-53c8-4e07-89cb-f67023b75fac 2147483648 Apr 28 19:16:58 devstack sudo[87421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:58 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-1a31f3dc-da80-41e3-b11b-1ca8cceaa419 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Create snapshot completed successfully Apr 28 19:16:59 devstack sudo[87421]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2dd1e29a-7f90-406d-b454-802842a3477c tempest-VolumesCloneNegativeTest-2134409161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-dbb48314-53c8-4e07-89cb-f67023b75fac 2147483648" returned: 0 in 0.886s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2dd1e29a-7f90-406d-b454-802842a3477c tempest-VolumesCloneNegativeTest-2134409161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-dbb48314-53c8-4e07-89cb-f67023b75fac {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:59 devstack sudo[87427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-dbb48314-53c8-4e07-89cb-f67023b75fac Apr 28 19:16:59 devstack sudo[87427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:59 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-117ddddc-c59c-45b5-a543-799937e683a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Acquiring lock "cinder-9680061b-2f16-422e-911b-3d80d4a35edd-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:16:59 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-117ddddc-c59c-45b5-a543-799937e683a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Lock "cinder-9680061b-2f16-422e-911b-3d80d4a35edd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:16:59 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-117ddddc-c59c-45b5-a543-799937e683a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Acquiring lock "cinder-quobyte-5329d833-0e77-4f52-8103-8649501f6dc5" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:16:59 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-117ddddc-c59c-45b5-a543-799937e683a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Lock "cinder-quobyte-5329d833-0e77-4f52-8103-8649501f6dc5" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:16:59 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-117ddddc-c59c-45b5-a543-799937e683a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Acquiring lock "cinder-quobyte-9680061b-2f16-422e-911b-3d80d4a35edd" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:16:59 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-117ddddc-c59c-45b5-a543-799937e683a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Lock "cinder-quobyte-9680061b-2f16-422e-911b-3d80d4a35edd" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:16:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-117ddddc-c59c-45b5-a543-799937e683a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Deleting offline snapshot 9680061b-2f16-422e-911b-3d80d4a35edd of volume 5329d833-0e77-4f52-8103-8649501f6dc5 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 19:16:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-117ddddc-c59c-45b5-a543-799937e683a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] snapshot_file for this snap is: volume-5329d833-0e77-4f52-8103-8649501f6dc5.9680061b-2f16-422e-911b-3d80d4a35edd {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 19:16:59 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[051a1e25-9e40-4c20-a076-322b0d9585d0]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:16:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-117ddddc-c59c-45b5-a543-799937e683a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5329d833-0e77-4f52-8103-8649501f6dc5.9680061b-2f16-422e-911b-3d80d4a35edd {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:59 devstack sudo[87427]: pam_unix(sudo:session): session closed for user root Apr 28 19:16:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2dd1e29a-7f90-406d-b454-802842a3477c tempest-VolumesCloneNegativeTest-2134409161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-dbb48314-53c8-4e07-89cb-f67023b75fac" returned: 0 in 0.637s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:16:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2dd1e29a-7f90-406d-b454-802842a3477c tempest-VolumesCloneNegativeTest-2134409161 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:16:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2dd1e29a-7f90-406d-b454-802842a3477c tempest-VolumesCloneNegativeTest-2134409161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:16:59 devstack sudo[87430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5329d833-0e77-4f52-8103-8649501f6dc5.9680061b-2f16-422e-911b-3d80d4a35edd Apr 28 19:16:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d9fd19ec-3dd0-48af-a40c-67c873ab0a0f tempest-SnapshotsActionsTest-904821522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.554s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:16:59 devstack sudo[87430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:16:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-d9fd19ec-3dd0-48af-a40c-67c873ab0a0f tempest-SnapshotsActionsTest-904821522 None] Creating offline snapshot 0ce5a205-c2a4-4850-89f5-54b27b94e7a3 of volume da601bc0-f975-4bd3-8926-4b6098299f9d {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 19:16:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2dd1e29a-7f90-406d-b454-802842a3477c tempest-VolumesCloneNegativeTest-2134409161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3403e8ed-1d00-423a-8f30-0f316c1b2b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbb48314-53c8-4e07-89cb-f67023b75fac', 'volume_size': 2}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:16:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2dd1e29a-7f90-406d-b454-802842a3477c tempest-VolumesCloneNegativeTest-2134409161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12171fbc-a739-4b06-8489-88cc66c8a856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:16:59 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d872c6-b065-4d01-afdc-887dd57eeeae]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:16:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d9fd19ec-3dd0-48af-a40c-67c873ab0a0f tempest-SnapshotsActionsTest-904821522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:16:59 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-2dd1e29a-7f90-406d-b454-802842a3477c tempest-VolumesCloneNegativeTest-2134409161 None] Volume volume-dbb48314-53c8-4e07-89cb-f67023b75fac (dbb48314-53c8-4e07-89cb-f67023b75fac): created successfully Apr 28 19:16:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2dd1e29a-7f90-406d-b454-802842a3477c tempest-VolumesCloneNegativeTest-2134409161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12171fbc-a739-4b06-8489-88cc66c8a856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:16:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2dd1e29a-7f90-406d-b454-802842a3477c tempest-VolumesCloneNegativeTest-2134409161 None] Flow 'volume_create_manager' (5b1181c3-c836-492d-9318-566b2c11f593) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:16:59 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-2dd1e29a-7f90-406d-b454-802842a3477c tempest-VolumesCloneNegativeTest-2134409161 None] Created volume successfully. Apr 28 19:17:00 devstack sudo[87432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe Apr 28 19:17:00 devstack sudo[87432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:00 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-65931ba9-98a6-4ce7-9d22-f9dd97243730 tempest-VolumesCloneNegativeTest-2134409161 None] Acquiring lock "cinder-dbb48314-53c8-4e07-89cb-f67023b75fac-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:17:00 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-65931ba9-98a6-4ce7-9d22-f9dd97243730 tempest-VolumesCloneNegativeTest-2134409161 None] Lock "cinder-dbb48314-53c8-4e07-89cb-f67023b75fac-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:17:00 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-65931ba9-98a6-4ce7-9d22-f9dd97243730 tempest-VolumesCloneNegativeTest-2134409161 None] Acquiring lock "cinder-quobyte-dbb48314-53c8-4e07-89cb-f67023b75fac" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:17:00 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-65931ba9-98a6-4ce7-9d22-f9dd97243730 tempest-VolumesCloneNegativeTest-2134409161 None] Lock "cinder-quobyte-dbb48314-53c8-4e07-89cb-f67023b75fac" acquired by "delete_volume" :: waited 0.022s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:17:00 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c450ab81-c4f1-4dbf-a8f6-13402cfcc8cc]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:17:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-65931ba9-98a6-4ce7-9d22-f9dd97243730 tempest-VolumesCloneNegativeTest-2134409161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-dbb48314-53c8-4e07-89cb-f67023b75fac {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:00 devstack sudo[87430]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-117ddddc-c59c-45b5-a543-799937e683a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5329d833-0e77-4f52-8103-8649501f6dc5.9680061b-2f16-422e-911b-3d80d4a35edd" returned: 0 in 0.915s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-117ddddc-c59c-45b5-a543-799937e683a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5329d833-0e77-4f52-8103-8649501f6dc5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:17:00 devstack sudo[87438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-dbb48314-53c8-4e07-89cb-f67023b75fac Apr 28 19:17:00 devstack sudo[87438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:00 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff6562b-707d-4fda-bc57-52ed93309b92]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:17:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-117ddddc-c59c-45b5-a543-799937e683a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5329d833-0e77-4f52-8103-8649501f6dc5 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:00 devstack sudo[87432]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d9fd19ec-3dd0-48af-a40c-67c873ab0a0f tempest-SnapshotsActionsTest-904821522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe" returned: 0 in 0.849s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-d9fd19ec-3dd0-48af-a40c-67c873ab0a0f tempest-SnapshotsActionsTest-904821522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da601bc0-f975-4bd3-8926-4b6098299f9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:17:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d9fd19ec-3dd0-48af-a40c-67c873ab0a0f tempest-SnapshotsActionsTest-904821522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.0ce5a205-c2a4-4850-89f5-54b27b94e7a3 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:00 devstack sudo[87444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.0ce5a205-c2a4-4850-89f5-54b27b94e7a3 1G Apr 28 19:17:00 devstack sudo[87444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:00 devstack sudo[87443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5329d833-0e77-4f52-8103-8649501f6dc5 Apr 28 19:17:00 devstack sudo[87443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:01 devstack sudo[87438]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-65931ba9-98a6-4ce7-9d22-f9dd97243730 tempest-VolumesCloneNegativeTest-2134409161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-dbb48314-53c8-4e07-89cb-f67023b75fac" returned: 0 in 0.795s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-65931ba9-98a6-4ce7-9d22-f9dd97243730 tempest-VolumesCloneNegativeTest-2134409161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-dbb48314-53c8-4e07-89cb-f67023b75fac {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:01 devstack sudo[87460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-dbb48314-53c8-4e07-89cb-f67023b75fac Apr 28 19:17:01 devstack sudo[87460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:01 devstack sudo[87443]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-117ddddc-c59c-45b5-a543-799937e683a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5329d833-0e77-4f52-8103-8649501f6dc5" returned: 0 in 0.787s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-117ddddc-c59c-45b5-a543-799937e683a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5329d833-0e77-4f52-8103-8649501f6dc5.9680061b-2f16-422e-911b-3d80d4a35edd {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:01 devstack sudo[87462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5329d833-0e77-4f52-8103-8649501f6dc5.9680061b-2f16-422e-911b-3d80d4a35edd Apr 28 19:17:01 devstack sudo[87462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:01 devstack sudo[87444]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d9fd19ec-3dd0-48af-a40c-67c873ab0a0f tempest-SnapshotsActionsTest-904821522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.0ce5a205-c2a4-4850-89f5-54b27b94e7a3 1G" returned: 0 in 0.939s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d9fd19ec-3dd0-48af-a40c-67c873ab0a0f tempest-SnapshotsActionsTest-904821522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.0ce5a205-c2a4-4850-89f5-54b27b94e7a3 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:01 devstack sudo[87465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.0ce5a205-c2a4-4850-89f5-54b27b94e7a3 Apr 28 19:17:01 devstack sudo[87465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:02 devstack sudo[87460]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-65931ba9-98a6-4ce7-9d22-f9dd97243730 tempest-VolumesCloneNegativeTest-2134409161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-dbb48314-53c8-4e07-89cb-f67023b75fac" returned: 0 in 0.677s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:02 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-65931ba9-98a6-4ce7-9d22-f9dd97243730 tempest-VolumesCloneNegativeTest-2134409161 None] Lock "cinder-quobyte-dbb48314-53c8-4e07-89cb-f67023b75fac" released by "delete_volume" :: held 1.547s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:17:02 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-65931ba9-98a6-4ce7-9d22-f9dd97243730 tempest-VolumesCloneNegativeTest-2134409161 None] Created reservations ['45b8de52-01ee-4609-8113-8a809f61c556', 'ff43640d-ce3e-405e-8584-46f6288edb83', '0a47dd59-c2eb-4731-a923-7a66cb53e0f0', '72c59fed-0c35-4594-a400-e4cea122687c'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:17:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-65931ba9-98a6-4ce7-9d22-f9dd97243730 tempest-VolumesCloneNegativeTest-2134409161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:17:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-65931ba9-98a6-4ce7-9d22-f9dd97243730 tempest-VolumesCloneNegativeTest-2134409161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:17:02 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-65931ba9-98a6-4ce7-9d22-f9dd97243730 tempest-VolumesCloneNegativeTest-2134409161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:17:02 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-65931ba9-98a6-4ce7-9d22-f9dd97243730 tempest-VolumesCloneNegativeTest-2134409161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:17:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-65931ba9-98a6-4ce7-9d22-f9dd97243730 tempest-VolumesCloneNegativeTest-2134409161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:17:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-65931ba9-98a6-4ce7-9d22-f9dd97243730 tempest-VolumesCloneNegativeTest-2134409161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:02 devstack sudo[87472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:17:02 devstack sudo[87472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:02 devstack sudo[87462]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-117ddddc-c59c-45b5-a543-799937e683a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5329d833-0e77-4f52-8103-8649501f6dc5.9680061b-2f16-422e-911b-3d80d4a35edd" returned: 0 in 0.801s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-117ddddc-c59c-45b5-a543-799937e683a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5329d833-0e77-4f52-8103-8649501f6dc5.9680061b-2f16-422e-911b-3d80d4a35edd {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:02 devstack sudo[87477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5329d833-0e77-4f52-8103-8649501f6dc5.9680061b-2f16-422e-911b-3d80d4a35edd Apr 28 19:17:02 devstack sudo[87477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:02 devstack sudo[87465]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d9fd19ec-3dd0-48af-a40c-67c873ab0a0f tempest-SnapshotsActionsTest-904821522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.0ce5a205-c2a4-4850-89f5-54b27b94e7a3" returned: 0 in 0.708s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:02 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-d9fd19ec-3dd0-48af-a40c-67c873ab0a0f tempest-SnapshotsActionsTest-904821522 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.0ce5a205-c2a4-4850-89f5-54b27b94e7a3 is being set with open permissions: ugo+rw Apr 28 19:17:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d9fd19ec-3dd0-48af-a40c-67c873ab0a0f tempest-SnapshotsActionsTest-904821522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.0ce5a205-c2a4-4850-89f5-54b27b94e7a3 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:02 devstack sudo[87479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.0ce5a205-c2a4-4850-89f5-54b27b94e7a3 Apr 28 19:17:02 devstack sudo[87479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:02 devstack sudo[87472]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-65931ba9-98a6-4ce7-9d22-f9dd97243730 tempest-VolumesCloneNegativeTest-2134409161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.718s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:02 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-65931ba9-98a6-4ce7-9d22-f9dd97243730 tempest-VolumesCloneNegativeTest-2134409161 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:17:02 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-65931ba9-98a6-4ce7-9d22-f9dd97243730 tempest-VolumesCloneNegativeTest-2134409161 None] Deleted volume successfully. Apr 28 19:17:02 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-65931ba9-98a6-4ce7-9d22-f9dd97243730 tempest-VolumesCloneNegativeTest-2134409161 None] Lock "cinder-dbb48314-53c8-4e07-89cb-f67023b75fac-delete_volume" released by "delete_volume" :: held 2.533s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:17:03 devstack sudo[87477]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-117ddddc-c59c-45b5-a543-799937e683a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5329d833-0e77-4f52-8103-8649501f6dc5.9680061b-2f16-422e-911b-3d80d4a35edd" returned: 0 in 0.788s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-117ddddc-c59c-45b5-a543-799937e683a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Lock "cinder-quobyte-9680061b-2f16-422e-911b-3d80d4a35edd" released by "_delete_snapshot" :: held 3.434s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:17:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-117ddddc-c59c-45b5-a543-799937e683a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Lock "cinder-quobyte-5329d833-0e77-4f52-8103-8649501f6dc5" released by "delete_snapshot" :: held 3.460s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:17:03 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-117ddddc-c59c-45b5-a543-799937e683a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Created reservations ['6f411bfe-d914-41eb-a498-6aa90eb37f5a', 'a43005a5-bd3d-4792-b22e-ff835bb3f910', 'a9a66eef-3419-418a-b8c2-a413226dc2b1', 'cc607498-3e4a-476d-8fe0-4410f21006ad'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:17:03 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-117ddddc-c59c-45b5-a543-799937e683a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Delete snapshot completed successfully. Apr 28 19:17:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-117ddddc-c59c-45b5-a543-799937e683a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Lock "cinder-9680061b-2f16-422e-911b-3d80d4a35edd-delete_snapshot" released by "delete_snapshot" :: held 3.604s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:17:03 devstack sudo[87479]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d9fd19ec-3dd0-48af-a40c-67c873ab0a0f tempest-SnapshotsActionsTest-904821522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.0ce5a205-c2a4-4850-89f5-54b27b94e7a3" returned: 0 in 0.844s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d9fd19ec-3dd0-48af-a40c-67c873ab0a0f tempest-SnapshotsActionsTest-904821522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.448s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:17:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-9435076a-de3c-4360-8781-199bd21b619e req-408b7861-5dcc-4323-87db-d2429c945a04 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.396s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:17:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-9435076a-de3c-4360-8781-199bd21b619e req-408b7861-5dcc-4323-87db-d2429c945a04 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:16:56Z,deleted=False,deleted_at=None,display_description='',display_name='a2522946-0c26-4a72-a97a-381b6bc68da5-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c07d1a36-dd01-4e4f-84b2-ad728bd12c58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc1948fb33ee4623afe433b535ba7283',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:16:57Z,use_quota=True,user_id='76eae2fdd3344aa28f0bb12673b1cb44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:17:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [req-9435076a-de3c-4360-8781-199bd21b619e req-408b7861-5dcc-4323-87db-d2429c945a04 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Creating volume c07d1a36-dd01-4e4f-84b2-ad728bd12c58 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:17:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-9435076a-de3c-4360-8781-199bd21b619e req-408b7861-5dcc-4323-87db-d2429c945a04 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:17:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-9435076a-de3c-4360-8781-199bd21b619e req-408b7861-5dcc-4323-87db-d2429c945a04 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:17:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-9435076a-de3c-4360-8781-199bd21b619e req-408b7861-5dcc-4323-87db-d2429c945a04 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:17:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-9435076a-de3c-4360-8781-199bd21b619e req-408b7861-5dcc-4323-87db-d2429c945a04 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:17:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-9435076a-de3c-4360-8781-199bd21b619e req-408b7861-5dcc-4323-87db-d2429c945a04 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:17:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-9435076a-de3c-4360-8781-199bd21b619e req-408b7861-5dcc-4323-87db-d2429c945a04 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:17:03 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [req-9435076a-de3c-4360-8781-199bd21b619e req-408b7861-5dcc-4323-87db-d2429c945a04 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:17:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-9435076a-de3c-4360-8781-199bd21b619e req-408b7861-5dcc-4323-87db-d2429c945a04 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c07d1a36-dd01-4e4f-84b2-ad728bd12c58 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:03 devstack sudo[87484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c07d1a36-dd01-4e4f-84b2-ad728bd12c58 1073741824 Apr 28 19:17:03 devstack sudo[87484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:03 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-d9fd19ec-3dd0-48af-a40c-67c873ab0a0f tempest-SnapshotsActionsTest-904821522 None] Create snapshot completed successfully Apr 28 19:17:03 devstack cinder-volume[83863]: DEBUG oslo_service.periodic_task [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 28 19:17:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:17:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:17:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:17:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:17:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:17:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:03 devstack sudo[87486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:17:03 devstack sudo[87486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-47829933-f8f8-41c4-bcfc-55c10580aa7c tempest-SnapshotsActionsTest-189624283 None] Acquiring lock "cinder-0ce5a205-c2a4-4850-89f5-54b27b94e7a3-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:17:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-47829933-f8f8-41c4-bcfc-55c10580aa7c tempest-SnapshotsActionsTest-189624283 None] Lock "cinder-0ce5a205-c2a4-4850-89f5-54b27b94e7a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:17:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-47829933-f8f8-41c4-bcfc-55c10580aa7c tempest-SnapshotsActionsTest-189624283 None] Acquiring lock "cinder-quobyte-da601bc0-f975-4bd3-8926-4b6098299f9d" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:17:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-47829933-f8f8-41c4-bcfc-55c10580aa7c tempest-SnapshotsActionsTest-189624283 None] Lock "cinder-quobyte-da601bc0-f975-4bd3-8926-4b6098299f9d" acquired by "delete_snapshot" :: waited 0.040s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:17:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-47829933-f8f8-41c4-bcfc-55c10580aa7c tempest-SnapshotsActionsTest-189624283 None] Acquiring lock "cinder-quobyte-0ce5a205-c2a4-4850-89f5-54b27b94e7a3" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:17:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-47829933-f8f8-41c4-bcfc-55c10580aa7c tempest-SnapshotsActionsTest-189624283 None] Lock "cinder-quobyte-0ce5a205-c2a4-4850-89f5-54b27b94e7a3" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:17:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-47829933-f8f8-41c4-bcfc-55c10580aa7c tempest-SnapshotsActionsTest-189624283 None] Deleting offline snapshot 0ce5a205-c2a4-4850-89f5-54b27b94e7a3 of volume da601bc0-f975-4bd3-8926-4b6098299f9d {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 19:17:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-47829933-f8f8-41c4-bcfc-55c10580aa7c tempest-SnapshotsActionsTest-189624283 None] snapshot_file for this snap is: volume-da601bc0-f975-4bd3-8926-4b6098299f9d.0ce5a205-c2a4-4850-89f5-54b27b94e7a3 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 19:17:03 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[efede864-9872-4148-88af-79dc1e30a390]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:17:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-47829933-f8f8-41c4-bcfc-55c10580aa7c tempest-SnapshotsActionsTest-189624283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.0ce5a205-c2a4-4850-89f5-54b27b94e7a3 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:04 devstack sudo[87489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.0ce5a205-c2a4-4850-89f5-54b27b94e7a3 Apr 28 19:17:04 devstack sudo[87489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:04 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0ee8a936-8f32-4663-9080-1ac4c63b6d4c tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Acquiring lock "cinder-5329d833-0e77-4f52-8103-8649501f6dc5-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:17:04 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0ee8a936-8f32-4663-9080-1ac4c63b6d4c tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Lock "cinder-5329d833-0e77-4f52-8103-8649501f6dc5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:17:04 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0ee8a936-8f32-4663-9080-1ac4c63b6d4c tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Acquiring lock "cinder-quobyte-5329d833-0e77-4f52-8103-8649501f6dc5" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:17:04 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0ee8a936-8f32-4663-9080-1ac4c63b6d4c tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Lock "cinder-quobyte-5329d833-0e77-4f52-8103-8649501f6dc5" acquired by "delete_volume" :: waited 0.031s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:17:04 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ec635b-c841-4b4c-930b-f2c6c4e556de]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:17:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0ee8a936-8f32-4663-9080-1ac4c63b6d4c tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5329d833-0e77-4f52-8103-8649501f6dc5 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:04 devstack sudo[87484]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-9435076a-de3c-4360-8781-199bd21b619e req-408b7861-5dcc-4323-87db-d2429c945a04 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c07d1a36-dd01-4e4f-84b2-ad728bd12c58 1073741824" returned: 0 in 1.159s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:04 devstack sudo[87496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5329d833-0e77-4f52-8103-8649501f6dc5 Apr 28 19:17:04 devstack sudo[87496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:04 devstack sudo[87486]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 1.127s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:04 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:17:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-9435076a-de3c-4360-8781-199bd21b619e req-408b7861-5dcc-4323-87db-d2429c945a04 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c07d1a36-dd01-4e4f-84b2-ad728bd12c58 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:04 devstack sudo[87498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c07d1a36-dd01-4e4f-84b2-ad728bd12c58 Apr 28 19:17:04 devstack sudo[87498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:05 devstack sudo[87489]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-47829933-f8f8-41c4-bcfc-55c10580aa7c tempest-SnapshotsActionsTest-189624283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.0ce5a205-c2a4-4850-89f5-54b27b94e7a3" returned: 0 in 1.096s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:05 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-47829933-f8f8-41c4-bcfc-55c10580aa7c tempest-SnapshotsActionsTest-189624283 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da601bc0-f975-4bd3-8926-4b6098299f9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:17:05 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e21314-39d4-43bb-b78b-899daf21fd82]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:17:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-47829933-f8f8-41c4-bcfc-55c10580aa7c tempest-SnapshotsActionsTest-189624283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:05 devstack sudo[87503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe Apr 28 19:17:05 devstack sudo[87503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:05 devstack sudo[87498]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-9435076a-de3c-4360-8781-199bd21b619e req-408b7861-5dcc-4323-87db-d2429c945a04 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c07d1a36-dd01-4e4f-84b2-ad728bd12c58" returned: 0 in 0.694s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:05 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-9435076a-de3c-4360-8781-199bd21b619e req-408b7861-5dcc-4323-87db-d2429c945a04 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] <== create_volume: return (1932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:17:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-9435076a-de3c-4360-8781-199bd21b619e req-408b7861-5dcc-4323-87db-d2429c945a04 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.936s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:17:05 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-9435076a-de3c-4360-8781-199bd21b619e req-408b7861-5dcc-4323-87db-d2429c945a04 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (298f4f5b-a0e0-4223-be04-c67aea4ed23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c07d1a36-dd01-4e4f-84b2-ad728bd12c58', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:05 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-9435076a-de3c-4360-8781-199bd21b619e req-408b7861-5dcc-4323-87db-d2429c945a04 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cd271c6-44cb-4dce-922f-8cf45abfb881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:05 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [req-9435076a-de3c-4360-8781-199bd21b619e req-408b7861-5dcc-4323-87db-d2429c945a04 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Volume volume-c07d1a36-dd01-4e4f-84b2-ad728bd12c58 (c07d1a36-dd01-4e4f-84b2-ad728bd12c58): created successfully Apr 28 19:17:05 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-9435076a-de3c-4360-8781-199bd21b619e req-408b7861-5dcc-4323-87db-d2429c945a04 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cd271c6-44cb-4dce-922f-8cf45abfb881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:05 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-9435076a-de3c-4360-8781-199bd21b619e req-408b7861-5dcc-4323-87db-d2429c945a04 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Flow 'volume_create_manager' (ab2e8a80-2081-4df6-9437-37cd77fe51c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:17:05 devstack sudo[87496]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0ee8a936-8f32-4663-9080-1ac4c63b6d4c tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5329d833-0e77-4f52-8103-8649501f6dc5" returned: 0 in 1.000s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0ee8a936-8f32-4663-9080-1ac4c63b6d4c tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5329d833-0e77-4f52-8103-8649501f6dc5 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:05 devstack cinder-volume[83863]: INFO cinder.volume.manager [req-9435076a-de3c-4360-8781-199bd21b619e req-408b7861-5dcc-4323-87db-d2429c945a04 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Created volume successfully. Apr 28 19:17:05 devstack sudo[87510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5329d833-0e77-4f52-8103-8649501f6dc5 Apr 28 19:17:05 devstack sudo[87510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:05 devstack sudo[87503]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-47829933-f8f8-41c4-bcfc-55c10580aa7c tempest-SnapshotsActionsTest-189624283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe" returned: 0 in 0.903s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:05 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-47829933-f8f8-41c4-bcfc-55c10580aa7c tempest-SnapshotsActionsTest-189624283 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da601bc0-f975-4bd3-8926-4b6098299f9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:17:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-47829933-f8f8-41c4-bcfc-55c10580aa7c tempest-SnapshotsActionsTest-189624283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.0ce5a205-c2a4-4850-89f5-54b27b94e7a3 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:06 devstack sudo[87516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.0ce5a205-c2a4-4850-89f5-54b27b94e7a3 Apr 28 19:17:06 devstack sudo[87516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:06 devstack sudo[87510]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0ee8a936-8f32-4663-9080-1ac4c63b6d4c tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5329d833-0e77-4f52-8103-8649501f6dc5" returned: 0 in 0.701s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:06 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0ee8a936-8f32-4663-9080-1ac4c63b6d4c tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Lock "cinder-quobyte-5329d833-0e77-4f52-8103-8649501f6dc5" released by "delete_volume" :: held 1.832s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:17:06 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-0ee8a936-8f32-4663-9080-1ac4c63b6d4c tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Created reservations ['7861985d-f062-4383-bb8c-2cedb880583d', '460e23e8-13dd-4434-a38c-4b0fb160e226', 'f98928d7-202e-4d08-b10d-390cd74e2ed4', '20182700-eafa-4052-a601-e308d3e24a59'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:17:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0ee8a936-8f32-4663-9080-1ac4c63b6d4c tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:17:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0ee8a936-8f32-4663-9080-1ac4c63b6d4c tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:17:06 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0ee8a936-8f32-4663-9080-1ac4c63b6d4c tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:17:06 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0ee8a936-8f32-4663-9080-1ac4c63b6d4c tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:17:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0ee8a936-8f32-4663-9080-1ac4c63b6d4c tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:17:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0ee8a936-8f32-4663-9080-1ac4c63b6d4c tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:06 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-33206cbd-835c-4c30-a96e-7537528fa872 tempest-CreateVolumesFromImageTest-1616363142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:17:06 devstack sudo[87521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:17:06 devstack sudo[87521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-33206cbd-835c-4c30-a96e-7537528fa872 tempest-CreateVolumesFromImageTest-1616363142 None] Flow 'volume_create_manager' (f9c558a9-4bab-4a99-be30-e97e8ed7700a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:17:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-33206cbd-835c-4c30-a96e-7537528fa872 tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47d4e1bd-f063-46ed-87f9-856600735dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-33206cbd-835c-4c30-a96e-7537528fa872 tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47d4e1bd-f063-46ed-87f9-856600735dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1196704951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d596878-b6b9-467e-88b9-3e30d86f7187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8361f00f2d7e4e568f208e2d9e9fcf5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:17:06Z,use_quota=True,user_id='822bd22bbd474c5c8bb1fca0b7f3310c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-33206cbd-835c-4c30-a96e-7537528fa872 tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49661808-d76f-4c51-b00f-e9527fc17b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-33206cbd-835c-4c30-a96e-7537528fa872 tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49661808-d76f-4c51-b00f-e9527fc17b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-33206cbd-835c-4c30-a96e-7537528fa872 tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b2a5c8c-1fdb-44ff-a70c-af3f7e936410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-33206cbd-835c-4c30-a96e-7537528fa872 tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b2a5c8c-1fdb-44ff-a70c-af3f7e936410) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d596878-b6b9-467e-88b9-3e30d86f7187', 'volume_name': 'volume-7d596878-b6b9-467e-88b9-3e30d86f7187', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-33206cbd-835c-4c30-a96e-7537528fa872 tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3053057d-9010-4a68-85a2-fa2c55ea9053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-33206cbd-835c-4c30-a96e-7537528fa872 tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3053057d-9010-4a68-85a2-fa2c55ea9053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-33206cbd-835c-4c30-a96e-7537528fa872 tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c65be45-77a0-41e7-ba24-749d84c9d256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:06 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-33206cbd-835c-4c30-a96e-7537528fa872 tempest-CreateVolumesFromImageTest-1616363142 None] Volume 7d596878-b6b9-467e-88b9-3e30d86f7187: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d596878-b6b9-467e-88b9-3e30d86f7187', 'volume_size': 1} Apr 28 19:17:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-33206cbd-835c-4c30-a96e-7537528fa872 tempest-CreateVolumesFromImageTest-1616363142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:17:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-33206cbd-835c-4c30-a96e-7537528fa872 tempest-CreateVolumesFromImageTest-1616363142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:17:06 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-33206cbd-835c-4c30-a96e-7537528fa872 tempest-CreateVolumesFromImageTest-1616363142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1196704951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d596878-b6b9-467e-88b9-3e30d86f7187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8361f00f2d7e4e568f208e2d9e9fcf5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:17:06Z,use_quota=True,user_id='822bd22bbd474c5c8bb1fca0b7f3310c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:17:06 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-33206cbd-835c-4c30-a96e-7537528fa872 tempest-CreateVolumesFromImageTest-1616363142 None] Creating volume 7d596878-b6b9-467e-88b9-3e30d86f7187 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:17:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-33206cbd-835c-4c30-a96e-7537528fa872 tempest-CreateVolumesFromImageTest-1616363142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:17:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-33206cbd-835c-4c30-a96e-7537528fa872 tempest-CreateVolumesFromImageTest-1616363142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:17:06 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-33206cbd-835c-4c30-a96e-7537528fa872 tempest-CreateVolumesFromImageTest-1616363142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:17:06 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-33206cbd-835c-4c30-a96e-7537528fa872 tempest-CreateVolumesFromImageTest-1616363142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:17:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-33206cbd-835c-4c30-a96e-7537528fa872 tempest-CreateVolumesFromImageTest-1616363142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:17:06 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-33206cbd-835c-4c30-a96e-7537528fa872 tempest-CreateVolumesFromImageTest-1616363142 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:17:06 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-33206cbd-835c-4c30-a96e-7537528fa872 tempest-CreateVolumesFromImageTest-1616363142 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:17:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-33206cbd-835c-4c30-a96e-7537528fa872 tempest-CreateVolumesFromImageTest-1616363142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7d596878-b6b9-467e-88b9-3e30d86f7187 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:06 devstack sudo[87528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7d596878-b6b9-467e-88b9-3e30d86f7187 1073741824 Apr 28 19:17:06 devstack sudo[87528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-9435076a-de3c-4360-8781-199bd21b619e req-6a705be6-9e5d-4633-8544-2634635533ce tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:17:06 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-4678f640-430e-40a7-b343-5cdb04fb444f tempest-CreateVolumesFromImageTest-1616363142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:17:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4678f640-430e-40a7-b343-5cdb04fb444f tempest-CreateVolumesFromImageTest-1616363142 None] Flow 'volume_create_manager' (06178300-3c62-4a1c-8bff-6e33bc39cd3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:17:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4678f640-430e-40a7-b343-5cdb04fb444f tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf63075b-eea9-48cc-b55a-ba4d2ba82a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4678f640-430e-40a7-b343-5cdb04fb444f tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf63075b-eea9-48cc-b55a-ba4d2ba82a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1886422989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eebd926-0d33-44b7-b6eb-7da14299e30d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8361f00f2d7e4e568f208e2d9e9fcf5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:17:07Z,use_quota=True,user_id='822bd22bbd474c5c8bb1fca0b7f3310c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4678f640-430e-40a7-b343-5cdb04fb444f tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bae0267-85e9-406e-80bb-9212ef6137a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4678f640-430e-40a7-b343-5cdb04fb444f tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bae0267-85e9-406e-80bb-9212ef6137a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4678f640-430e-40a7-b343-5cdb04fb444f tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e815ba4b-1d65-4e80-ab73-0a82532ac662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4678f640-430e-40a7-b343-5cdb04fb444f tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e815ba4b-1d65-4e80-ab73-0a82532ac662) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6eebd926-0d33-44b7-b6eb-7da14299e30d', 'volume_name': 'volume-6eebd926-0d33-44b7-b6eb-7da14299e30d', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4678f640-430e-40a7-b343-5cdb04fb444f tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ccf5650-efe6-4cfe-8f8a-fe512d2833d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4678f640-430e-40a7-b343-5cdb04fb444f tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ccf5650-efe6-4cfe-8f8a-fe512d2833d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4678f640-430e-40a7-b343-5cdb04fb444f tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0ef8af2-1c48-4a29-a1e1-5fa3c5b29545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:06 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-4678f640-430e-40a7-b343-5cdb04fb444f tempest-CreateVolumesFromImageTest-1616363142 None] Volume 6eebd926-0d33-44b7-b6eb-7da14299e30d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6eebd926-0d33-44b7-b6eb-7da14299e30d', 'volume_size': 1} Apr 28 19:17:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4678f640-430e-40a7-b343-5cdb04fb444f tempest-CreateVolumesFromImageTest-1616363142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:17:07 devstack sudo[87516]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-47829933-f8f8-41c4-bcfc-55c10580aa7c tempest-SnapshotsActionsTest-189624283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.0ce5a205-c2a4-4850-89f5-54b27b94e7a3" returned: 0 in 1.171s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-47829933-f8f8-41c4-bcfc-55c10580aa7c tempest-SnapshotsActionsTest-189624283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.0ce5a205-c2a4-4850-89f5-54b27b94e7a3 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:07 devstack sudo[87535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.0ce5a205-c2a4-4850-89f5-54b27b94e7a3 Apr 28 19:17:07 devstack sudo[87535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:07 devstack sudo[87521]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0ee8a936-8f32-4663-9080-1ac4c63b6d4c tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.955s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:07 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-0ee8a936-8f32-4663-9080-1ac4c63b6d4c tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:17:07 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-0ee8a936-8f32-4663-9080-1ac4c63b6d4c tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Deleted volume successfully. Apr 28 19:17:07 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0ee8a936-8f32-4663-9080-1ac4c63b6d4c tempest-VolumeSnapshotQuotasNegativeTestJSON-1272173897 None] Lock "cinder-5329d833-0e77-4f52-8103-8649501f6dc5-delete_volume" released by "delete_volume" :: held 3.160s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:17:07 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6162c07-8143-4b9d-b36e-1f69f75f8b4b tempest-CreateVolumesFromImageTest-1616363142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:17:07 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c6162c07-8143-4b9d-b36e-1f69f75f8b4b tempest-CreateVolumesFromImageTest-1616363142 None] Flow 'volume_create_manager' (d6cc968d-05ae-4b20-bbb4-a64282fff8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:17:07 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c6162c07-8143-4b9d-b36e-1f69f75f8b4b tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03a1d03e-4fe2-439c-877c-5019249284ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:07 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c6162c07-8143-4b9d-b36e-1f69f75f8b4b tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03a1d03e-4fe2-439c-877c-5019249284ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-403851157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfec46df-cea0-41c3-b5f9-42372753836c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8361f00f2d7e4e568f208e2d9e9fcf5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:17:07Z,use_quota=True,user_id='822bd22bbd474c5c8bb1fca0b7f3310c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:07 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c6162c07-8143-4b9d-b36e-1f69f75f8b4b tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (145a9b8c-a413-47a7-9a5c-49fa4c196a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:07 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c6162c07-8143-4b9d-b36e-1f69f75f8b4b tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (145a9b8c-a413-47a7-9a5c-49fa4c196a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:07 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c6162c07-8143-4b9d-b36e-1f69f75f8b4b tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (258140d7-ad51-4249-a2df-a2b8d1990d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:07 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c6162c07-8143-4b9d-b36e-1f69f75f8b4b tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (258140d7-ad51-4249-a2df-a2b8d1990d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfec46df-cea0-41c3-b5f9-42372753836c', 'volume_name': 'volume-bfec46df-cea0-41c3-b5f9-42372753836c', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:07 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c6162c07-8143-4b9d-b36e-1f69f75f8b4b tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff76024f-cdbb-490d-afff-f78fd262be5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:07 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c6162c07-8143-4b9d-b36e-1f69f75f8b4b tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff76024f-cdbb-490d-afff-f78fd262be5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:07 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c6162c07-8143-4b9d-b36e-1f69f75f8b4b tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4917eef1-1ec5-467b-8591-2e84b03641a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:07 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-c6162c07-8143-4b9d-b36e-1f69f75f8b4b tempest-CreateVolumesFromImageTest-1616363142 None] Volume bfec46df-cea0-41c3-b5f9-42372753836c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfec46df-cea0-41c3-b5f9-42372753836c', 'volume_size': 1} Apr 28 19:17:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c6162c07-8143-4b9d-b36e-1f69f75f8b4b tempest-CreateVolumesFromImageTest-1616363142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:17:07 devstack sudo[87528]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-33206cbd-835c-4c30-a96e-7537528fa872 tempest-CreateVolumesFromImageTest-1616363142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7d596878-b6b9-467e-88b9-3e30d86f7187 1073741824" returned: 0 in 1.162s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-33206cbd-835c-4c30-a96e-7537528fa872 tempest-CreateVolumesFromImageTest-1616363142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7d596878-b6b9-467e-88b9-3e30d86f7187 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:07 devstack sudo[87540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7d596878-b6b9-467e-88b9-3e30d86f7187 Apr 28 19:17:07 devstack sudo[87540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:07 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-b910bcaf-1834-4de1-838b-3d9ab0c7cf04 tempest-CreateVolumesFromImageTest-1616363142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:17:07 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b910bcaf-1834-4de1-838b-3d9ab0c7cf04 tempest-CreateVolumesFromImageTest-1616363142 None] Flow 'volume_create_manager' (8d1473f6-947a-4648-a33d-62cd56450e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:17:07 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b910bcaf-1834-4de1-838b-3d9ab0c7cf04 tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (559bd1a1-49ea-484f-826a-a8f0265f3474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:07 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b910bcaf-1834-4de1-838b-3d9ab0c7cf04 tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (559bd1a1-49ea-484f-826a-a8f0265f3474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:17:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1166507630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf447c7a-c083-420d-8e51-53c0f29263e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8361f00f2d7e4e568f208e2d9e9fcf5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:17:08Z,use_quota=True,user_id='822bd22bbd474c5c8bb1fca0b7f3310c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:07 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b910bcaf-1834-4de1-838b-3d9ab0c7cf04 tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a22a2c7-0bc0-4124-8b8c-972147a0ade8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:07 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b910bcaf-1834-4de1-838b-3d9ab0c7cf04 tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a22a2c7-0bc0-4124-8b8c-972147a0ade8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:07 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b910bcaf-1834-4de1-838b-3d9ab0c7cf04 tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92bc3522-27a8-4601-b2ff-ac114010cb26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:08 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b910bcaf-1834-4de1-838b-3d9ab0c7cf04 tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92bc3522-27a8-4601-b2ff-ac114010cb26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf447c7a-c083-420d-8e51-53c0f29263e9', 'volume_name': 'volume-cf447c7a-c083-420d-8e51-53c0f29263e9', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:08 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b910bcaf-1834-4de1-838b-3d9ab0c7cf04 tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6145d2b8-9a58-4766-8c75-0c392ffa0f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:08 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b910bcaf-1834-4de1-838b-3d9ab0c7cf04 tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6145d2b8-9a58-4766-8c75-0c392ffa0f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:08 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b910bcaf-1834-4de1-838b-3d9ab0c7cf04 tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a605cc3-a82e-4ab5-93c7-fa94178f4f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:08 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-b910bcaf-1834-4de1-838b-3d9ab0c7cf04 tempest-CreateVolumesFromImageTest-1616363142 None] Volume cf447c7a-c083-420d-8e51-53c0f29263e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf447c7a-c083-420d-8e51-53c0f29263e9', 'volume_size': 1} Apr 28 19:17:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b910bcaf-1834-4de1-838b-3d9ab0c7cf04 tempest-CreateVolumesFromImageTest-1616363142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:17:08 devstack sudo[87535]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-47829933-f8f8-41c4-bcfc-55c10580aa7c tempest-SnapshotsActionsTest-189624283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.0ce5a205-c2a4-4850-89f5-54b27b94e7a3" returned: 0 in 0.950s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:08 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-47829933-f8f8-41c4-bcfc-55c10580aa7c tempest-SnapshotsActionsTest-189624283 None] Lock "cinder-quobyte-0ce5a205-c2a4-4850-89f5-54b27b94e7a3" released by "_delete_snapshot" :: held 4.265s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:17:08 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-47829933-f8f8-41c4-bcfc-55c10580aa7c tempest-SnapshotsActionsTest-189624283 None] Lock "cinder-quobyte-da601bc0-f975-4bd3-8926-4b6098299f9d" released by "delete_snapshot" :: held 4.311s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:17:08 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-47829933-f8f8-41c4-bcfc-55c10580aa7c tempest-SnapshotsActionsTest-189624283 None] Created reservations ['e46bfbfc-78dc-4e59-94a9-5e310dab94a1', 'b489e25b-dcf0-469f-b30f-921bcd7a00b3', '3d181925-397b-4ae1-956b-bc21894fa300', '72ed6ad5-9bd7-40d5-b891-227a9f61dea3'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:17:08 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-2995bf9f-6e7e-4e01-89c0-3075c0b0837e tempest-CreateVolumesFromImageTest-1616363142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:17:08 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2995bf9f-6e7e-4e01-89c0-3075c0b0837e tempest-CreateVolumesFromImageTest-1616363142 None] Flow 'volume_create_manager' (65eb285f-b104-4539-8b2a-d4e37fe0ebcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:17:08 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2995bf9f-6e7e-4e01-89c0-3075c0b0837e tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95eed773-9d27-4eaa-9bbc-cc3f6eda326d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:08 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2995bf9f-6e7e-4e01-89c0-3075c0b0837e tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95eed773-9d27-4eaa-9bbc-cc3f6eda326d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:17:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1855732740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6fff168-9ee8-4b24-97d8-fd3382437ab2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8361f00f2d7e4e568f208e2d9e9fcf5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:17:08Z,use_quota=True,user_id='822bd22bbd474c5c8bb1fca0b7f3310c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:08 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2995bf9f-6e7e-4e01-89c0-3075c0b0837e tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (222bdc72-56b1-44f2-8e3c-fd628cc800fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:08 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2995bf9f-6e7e-4e01-89c0-3075c0b0837e tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (222bdc72-56b1-44f2-8e3c-fd628cc800fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:08 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2995bf9f-6e7e-4e01-89c0-3075c0b0837e tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (158229ea-984f-4619-bb77-1a453cbb69e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:08 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2995bf9f-6e7e-4e01-89c0-3075c0b0837e tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (158229ea-984f-4619-bb77-1a453cbb69e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6fff168-9ee8-4b24-97d8-fd3382437ab2', 'volume_name': 'volume-b6fff168-9ee8-4b24-97d8-fd3382437ab2', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:08 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2995bf9f-6e7e-4e01-89c0-3075c0b0837e tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69f8bbb9-3d5f-45ac-b4be-d847141d7e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:08 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2995bf9f-6e7e-4e01-89c0-3075c0b0837e tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69f8bbb9-3d5f-45ac-b4be-d847141d7e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:08 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2995bf9f-6e7e-4e01-89c0-3075c0b0837e tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a8a26b8-49db-4861-bba7-e4ee4334d009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:08 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-2995bf9f-6e7e-4e01-89c0-3075c0b0837e tempest-CreateVolumesFromImageTest-1616363142 None] Volume b6fff168-9ee8-4b24-97d8-fd3382437ab2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6fff168-9ee8-4b24-97d8-fd3382437ab2', 'volume_size': 1} Apr 28 19:17:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2995bf9f-6e7e-4e01-89c0-3075c0b0837e tempest-CreateVolumesFromImageTest-1616363142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:17:08 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-47829933-f8f8-41c4-bcfc-55c10580aa7c tempest-SnapshotsActionsTest-189624283 None] Delete snapshot completed successfully. Apr 28 19:17:08 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-47829933-f8f8-41c4-bcfc-55c10580aa7c tempest-SnapshotsActionsTest-189624283 None] Lock "cinder-0ce5a205-c2a4-4850-89f5-54b27b94e7a3-delete_snapshot" released by "delete_snapshot" :: held 4.642s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:17:08 devstack sudo[87540]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-33206cbd-835c-4c30-a96e-7537528fa872 tempest-CreateVolumesFromImageTest-1616363142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7d596878-b6b9-467e-88b9-3e30d86f7187" returned: 0 in 0.849s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:08 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-33206cbd-835c-4c30-a96e-7537528fa872 tempest-CreateVolumesFromImageTest-1616363142 None] <== create_volume: return (2081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:17:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-33206cbd-835c-4c30-a96e-7537528fa872 tempest-CreateVolumesFromImageTest-1616363142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.085s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:17:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-9435076a-de3c-4360-8781-199bd21b619e req-6a705be6-9e5d-4633-8544-2634635533ce tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.930s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:17:08 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-33206cbd-835c-4c30-a96e-7537528fa872 tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c65be45-77a0-41e7-ba24-749d84c9d256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d596878-b6b9-467e-88b9-3e30d86f7187', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:08 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-33206cbd-835c-4c30-a96e-7537528fa872 tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab9cef55-141a-4361-9e95-c33c13714195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:08 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f81b83c-ea48-4259-a56f-4c6758fd1205]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:17:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-9435076a-de3c-4360-8781-199bd21b619e req-6a705be6-9e5d-4633-8544-2634635533ce tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c07d1a36-dd01-4e4f-84b2-ad728bd12c58 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:08 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-33206cbd-835c-4c30-a96e-7537528fa872 tempest-CreateVolumesFromImageTest-1616363142 None] Volume volume-7d596878-b6b9-467e-88b9-3e30d86f7187 (7d596878-b6b9-467e-88b9-3e30d86f7187): created successfully Apr 28 19:17:08 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-33206cbd-835c-4c30-a96e-7537528fa872 tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab9cef55-141a-4361-9e95-c33c13714195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:08 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-33206cbd-835c-4c30-a96e-7537528fa872 tempest-CreateVolumesFromImageTest-1616363142 None] Flow 'volume_create_manager' (f9c558a9-4bab-4a99-be30-e97e8ed7700a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:17:08 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-33206cbd-835c-4c30-a96e-7537528fa872 tempest-CreateVolumesFromImageTest-1616363142 None] Created volume successfully. Apr 28 19:17:08 devstack sudo[87544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c07d1a36-dd01-4e4f-84b2-ad728bd12c58 Apr 28 19:17:08 devstack sudo[87544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-722e413b-f28d-4715-9611-2a11266d2cb5 tempest-SnapshotsActionsTest-904821522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:17:09 devstack sudo[87544]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-9435076a-de3c-4360-8781-199bd21b619e req-6a705be6-9e5d-4633-8544-2634635533ce tempest-ServerBootFromVolumeStableRescueTest-647471535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c07d1a36-dd01-4e4f-84b2-ad728bd12c58" returned: 0 in 0.926s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-9435076a-de3c-4360-8781-199bd21b619e req-6a705be6-9e5d-4633-8544-2634635533ce tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.970s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:17:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4678f640-430e-40a7-b343-5cdb04fb444f tempest-CreateVolumesFromImageTest-1616363142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.738s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:17:09 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4678f640-430e-40a7-b343-5cdb04fb444f tempest-CreateVolumesFromImageTest-1616363142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1886422989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eebd926-0d33-44b7-b6eb-7da14299e30d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8361f00f2d7e4e568f208e2d9e9fcf5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:17:07Z,use_quota=True,user_id='822bd22bbd474c5c8bb1fca0b7f3310c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:17:09 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-4678f640-430e-40a7-b343-5cdb04fb444f tempest-CreateVolumesFromImageTest-1616363142 None] Creating volume 6eebd926-0d33-44b7-b6eb-7da14299e30d {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:17:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4678f640-430e-40a7-b343-5cdb04fb444f tempest-CreateVolumesFromImageTest-1616363142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:17:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4678f640-430e-40a7-b343-5cdb04fb444f tempest-CreateVolumesFromImageTest-1616363142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:17:09 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4678f640-430e-40a7-b343-5cdb04fb444f tempest-CreateVolumesFromImageTest-1616363142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:17:09 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4678f640-430e-40a7-b343-5cdb04fb444f tempest-CreateVolumesFromImageTest-1616363142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:17:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4678f640-430e-40a7-b343-5cdb04fb444f tempest-CreateVolumesFromImageTest-1616363142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:17:09 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4678f640-430e-40a7-b343-5cdb04fb444f tempest-CreateVolumesFromImageTest-1616363142 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:17:09 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-4678f640-430e-40a7-b343-5cdb04fb444f tempest-CreateVolumesFromImageTest-1616363142 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:17:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4678f640-430e-40a7-b343-5cdb04fb444f tempest-CreateVolumesFromImageTest-1616363142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6eebd926-0d33-44b7-b6eb-7da14299e30d 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:09 devstack sudo[87549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6eebd926-0d33-44b7-b6eb-7da14299e30d 1073741824 Apr 28 19:17:09 devstack sudo[87549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:09 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-9435076a-de3c-4360-8781-199bd21b619e req-6a705be6-9e5d-4633-8544-2634635533ce tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd', 'name': 'volume-c07d1a36-dd01-4e4f-84b2-ad728bd12c58', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f30928ca-069e-447f-b479-074b9d3a4f72', 'enforce_multipath': True} {{(pid=83863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 28 19:17:09 devstack cinder-volume[83863]: INFO cinder.volume.manager [req-9435076a-de3c-4360-8781-199bd21b619e req-6a705be6-9e5d-4633-8544-2634635533ce tempest-ServerBootFromVolumeStableRescueTest-647471535 None] attachment_update completed successfully. Apr 28 19:17:10 devstack sudo[87549]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4678f640-430e-40a7-b343-5cdb04fb444f tempest-CreateVolumesFromImageTest-1616363142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6eebd926-0d33-44b7-b6eb-7da14299e30d 1073741824" returned: 0 in 0.947s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4678f640-430e-40a7-b343-5cdb04fb444f tempest-CreateVolumesFromImageTest-1616363142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6eebd926-0d33-44b7-b6eb-7da14299e30d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:10 devstack sudo[87556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6eebd926-0d33-44b7-b6eb-7da14299e30d Apr 28 19:17:10 devstack sudo[87556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:11 devstack sudo[87556]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4678f640-430e-40a7-b343-5cdb04fb444f tempest-CreateVolumesFromImageTest-1616363142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6eebd926-0d33-44b7-b6eb-7da14299e30d" returned: 0 in 0.673s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4678f640-430e-40a7-b343-5cdb04fb444f tempest-CreateVolumesFromImageTest-1616363142 None] <== create_volume: return (1659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:17:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4678f640-430e-40a7-b343-5cdb04fb444f tempest-CreateVolumesFromImageTest-1616363142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:17:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c6162c07-8143-4b9d-b36e-1f69f75f8b4b tempest-CreateVolumesFromImageTest-1616363142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.645s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:17:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c6162c07-8143-4b9d-b36e-1f69f75f8b4b tempest-CreateVolumesFromImageTest-1616363142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-403851157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfec46df-cea0-41c3-b5f9-42372753836c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8361f00f2d7e4e568f208e2d9e9fcf5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:17:07Z,use_quota=True,user_id='822bd22bbd474c5c8bb1fca0b7f3310c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:17:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-c6162c07-8143-4b9d-b36e-1f69f75f8b4b tempest-CreateVolumesFromImageTest-1616363142 None] Creating volume bfec46df-cea0-41c3-b5f9-42372753836c {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:17:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c6162c07-8143-4b9d-b36e-1f69f75f8b4b tempest-CreateVolumesFromImageTest-1616363142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:17:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c6162c07-8143-4b9d-b36e-1f69f75f8b4b tempest-CreateVolumesFromImageTest-1616363142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:17:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c6162c07-8143-4b9d-b36e-1f69f75f8b4b tempest-CreateVolumesFromImageTest-1616363142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:17:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c6162c07-8143-4b9d-b36e-1f69f75f8b4b tempest-CreateVolumesFromImageTest-1616363142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:17:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c6162c07-8143-4b9d-b36e-1f69f75f8b4b tempest-CreateVolumesFromImageTest-1616363142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:17:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c6162c07-8143-4b9d-b36e-1f69f75f8b4b tempest-CreateVolumesFromImageTest-1616363142 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:17:11 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-c6162c07-8143-4b9d-b36e-1f69f75f8b4b tempest-CreateVolumesFromImageTest-1616363142 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:17:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c6162c07-8143-4b9d-b36e-1f69f75f8b4b tempest-CreateVolumesFromImageTest-1616363142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bfec46df-cea0-41c3-b5f9-42372753836c 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4678f640-430e-40a7-b343-5cdb04fb444f tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0ef8af2-1c48-4a29-a1e1-5fa3c5b29545) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6eebd926-0d33-44b7-b6eb-7da14299e30d', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4678f640-430e-40a7-b343-5cdb04fb444f tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0de2450-fec0-45bd-bf22-b307f2d211db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:11 devstack sudo[87559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bfec46df-cea0-41c3-b5f9-42372753836c 1073741824 Apr 28 19:17:11 devstack sudo[87559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:11 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-4678f640-430e-40a7-b343-5cdb04fb444f tempest-CreateVolumesFromImageTest-1616363142 None] Volume volume-6eebd926-0d33-44b7-b6eb-7da14299e30d (6eebd926-0d33-44b7-b6eb-7da14299e30d): created successfully Apr 28 19:17:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4678f640-430e-40a7-b343-5cdb04fb444f tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0de2450-fec0-45bd-bf22-b307f2d211db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4678f640-430e-40a7-b343-5cdb04fb444f tempest-CreateVolumesFromImageTest-1616363142 None] Flow 'volume_create_manager' (06178300-3c62-4a1c-8bff-6e33bc39cd3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:17:11 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-4678f640-430e-40a7-b343-5cdb04fb444f tempest-CreateVolumesFromImageTest-1616363142 None] Created volume successfully. Apr 28 19:17:12 devstack sudo[87559]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c6162c07-8143-4b9d-b36e-1f69f75f8b4b tempest-CreateVolumesFromImageTest-1616363142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bfec46df-cea0-41c3-b5f9-42372753836c 1073741824" returned: 0 in 0.907s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c6162c07-8143-4b9d-b36e-1f69f75f8b4b tempest-CreateVolumesFromImageTest-1616363142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bfec46df-cea0-41c3-b5f9-42372753836c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:12 devstack sudo[87631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bfec46df-cea0-41c3-b5f9-42372753836c Apr 28 19:17:12 devstack sudo[87631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:12 devstack sudo[87631]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c6162c07-8143-4b9d-b36e-1f69f75f8b4b tempest-CreateVolumesFromImageTest-1616363142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bfec46df-cea0-41c3-b5f9-42372753836c" returned: 0 in 0.624s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:12 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c6162c07-8143-4b9d-b36e-1f69f75f8b4b tempest-CreateVolumesFromImageTest-1616363142 None] <== create_volume: return (1578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:17:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c6162c07-8143-4b9d-b36e-1f69f75f8b4b tempest-CreateVolumesFromImageTest-1616363142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.582s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:17:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b910bcaf-1834-4de1-838b-3d9ab0c7cf04 tempest-CreateVolumesFromImageTest-1616363142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.782s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:17:12 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b910bcaf-1834-4de1-838b-3d9ab0c7cf04 tempest-CreateVolumesFromImageTest-1616363142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:17:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1166507630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf447c7a-c083-420d-8e51-53c0f29263e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8361f00f2d7e4e568f208e2d9e9fcf5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:17:08Z,use_quota=True,user_id='822bd22bbd474c5c8bb1fca0b7f3310c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:17:12 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-b910bcaf-1834-4de1-838b-3d9ab0c7cf04 tempest-CreateVolumesFromImageTest-1616363142 None] Creating volume cf447c7a-c083-420d-8e51-53c0f29263e9 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:17:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b910bcaf-1834-4de1-838b-3d9ab0c7cf04 tempest-CreateVolumesFromImageTest-1616363142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:17:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b910bcaf-1834-4de1-838b-3d9ab0c7cf04 tempest-CreateVolumesFromImageTest-1616363142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:17:12 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b910bcaf-1834-4de1-838b-3d9ab0c7cf04 tempest-CreateVolumesFromImageTest-1616363142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:17:12 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b910bcaf-1834-4de1-838b-3d9ab0c7cf04 tempest-CreateVolumesFromImageTest-1616363142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:17:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b910bcaf-1834-4de1-838b-3d9ab0c7cf04 tempest-CreateVolumesFromImageTest-1616363142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:17:12 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b910bcaf-1834-4de1-838b-3d9ab0c7cf04 tempest-CreateVolumesFromImageTest-1616363142 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:17:12 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-b910bcaf-1834-4de1-838b-3d9ab0c7cf04 tempest-CreateVolumesFromImageTest-1616363142 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:17:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b910bcaf-1834-4de1-838b-3d9ab0c7cf04 tempest-CreateVolumesFromImageTest-1616363142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cf447c7a-c083-420d-8e51-53c0f29263e9 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:12 devstack sudo[87634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cf447c7a-c083-420d-8e51-53c0f29263e9 1073741824 Apr 28 19:17:12 devstack sudo[87634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:12 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c6162c07-8143-4b9d-b36e-1f69f75f8b4b tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4917eef1-1ec5-467b-8591-2e84b03641a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfec46df-cea0-41c3-b5f9-42372753836c', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:12 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c6162c07-8143-4b9d-b36e-1f69f75f8b4b tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8b7ab27-3d57-40fd-b2d8-073b7380e19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:12 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-c6162c07-8143-4b9d-b36e-1f69f75f8b4b tempest-CreateVolumesFromImageTest-1616363142 None] Volume volume-bfec46df-cea0-41c3-b5f9-42372753836c (bfec46df-cea0-41c3-b5f9-42372753836c): created successfully Apr 28 19:17:12 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c6162c07-8143-4b9d-b36e-1f69f75f8b4b tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8b7ab27-3d57-40fd-b2d8-073b7380e19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:12 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c6162c07-8143-4b9d-b36e-1f69f75f8b4b tempest-CreateVolumesFromImageTest-1616363142 None] Flow 'volume_create_manager' (d6cc968d-05ae-4b20-bbb4-a64282fff8e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:17:12 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-c6162c07-8143-4b9d-b36e-1f69f75f8b4b tempest-CreateVolumesFromImageTest-1616363142 None] Created volume successfully. Apr 28 19:17:13 devstack sudo[87634]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b910bcaf-1834-4de1-838b-3d9ab0c7cf04 tempest-CreateVolumesFromImageTest-1616363142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cf447c7a-c083-420d-8e51-53c0f29263e9 1073741824" returned: 0 in 0.847s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b910bcaf-1834-4de1-838b-3d9ab0c7cf04 tempest-CreateVolumesFromImageTest-1616363142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cf447c7a-c083-420d-8e51-53c0f29263e9 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:13 devstack sudo[87643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cf447c7a-c083-420d-8e51-53c0f29263e9 Apr 28 19:17:13 devstack sudo[87643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:14 devstack sudo[87643]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b910bcaf-1834-4de1-838b-3d9ab0c7cf04 tempest-CreateVolumesFromImageTest-1616363142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cf447c7a-c083-420d-8e51-53c0f29263e9" returned: 0 in 0.658s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:14 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b910bcaf-1834-4de1-838b-3d9ab0c7cf04 tempest-CreateVolumesFromImageTest-1616363142 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:17:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b910bcaf-1834-4de1-838b-3d9ab0c7cf04 tempest-CreateVolumesFromImageTest-1616363142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:17:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2995bf9f-6e7e-4e01-89c0-3075c0b0837e tempest-CreateVolumesFromImageTest-1616363142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.954s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:17:14 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2995bf9f-6e7e-4e01-89c0-3075c0b0837e tempest-CreateVolumesFromImageTest-1616363142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:17:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1855732740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6fff168-9ee8-4b24-97d8-fd3382437ab2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8361f00f2d7e4e568f208e2d9e9fcf5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:17:08Z,use_quota=True,user_id='822bd22bbd474c5c8bb1fca0b7f3310c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:17:14 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-2995bf9f-6e7e-4e01-89c0-3075c0b0837e tempest-CreateVolumesFromImageTest-1616363142 None] Creating volume b6fff168-9ee8-4b24-97d8-fd3382437ab2 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:17:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2995bf9f-6e7e-4e01-89c0-3075c0b0837e tempest-CreateVolumesFromImageTest-1616363142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:17:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2995bf9f-6e7e-4e01-89c0-3075c0b0837e tempest-CreateVolumesFromImageTest-1616363142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:17:14 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2995bf9f-6e7e-4e01-89c0-3075c0b0837e tempest-CreateVolumesFromImageTest-1616363142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:17:14 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2995bf9f-6e7e-4e01-89c0-3075c0b0837e tempest-CreateVolumesFromImageTest-1616363142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:17:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2995bf9f-6e7e-4e01-89c0-3075c0b0837e tempest-CreateVolumesFromImageTest-1616363142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:17:14 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2995bf9f-6e7e-4e01-89c0-3075c0b0837e tempest-CreateVolumesFromImageTest-1616363142 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:17:14 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-2995bf9f-6e7e-4e01-89c0-3075c0b0837e tempest-CreateVolumesFromImageTest-1616363142 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:17:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2995bf9f-6e7e-4e01-89c0-3075c0b0837e tempest-CreateVolumesFromImageTest-1616363142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b6fff168-9ee8-4b24-97d8-fd3382437ab2 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b910bcaf-1834-4de1-838b-3d9ab0c7cf04 tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a605cc3-a82e-4ab5-93c7-fa94178f4f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf447c7a-c083-420d-8e51-53c0f29263e9', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b910bcaf-1834-4de1-838b-3d9ab0c7cf04 tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (251db580-94a0-4c44-aa31-2ca83b4ae148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:14 devstack sudo[87646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b6fff168-9ee8-4b24-97d8-fd3382437ab2 1073741824 Apr 28 19:17:14 devstack sudo[87646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:14 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-b910bcaf-1834-4de1-838b-3d9ab0c7cf04 tempest-CreateVolumesFromImageTest-1616363142 None] Volume volume-cf447c7a-c083-420d-8e51-53c0f29263e9 (cf447c7a-c083-420d-8e51-53c0f29263e9): created successfully Apr 28 19:17:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b910bcaf-1834-4de1-838b-3d9ab0c7cf04 tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (251db580-94a0-4c44-aa31-2ca83b4ae148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b910bcaf-1834-4de1-838b-3d9ab0c7cf04 tempest-CreateVolumesFromImageTest-1616363142 None] Flow 'volume_create_manager' (8d1473f6-947a-4648-a33d-62cd56450e54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:17:14 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-b910bcaf-1834-4de1-838b-3d9ab0c7cf04 tempest-CreateVolumesFromImageTest-1616363142 None] Created volume successfully. Apr 28 19:17:15 devstack sudo[87646]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2995bf9f-6e7e-4e01-89c0-3075c0b0837e tempest-CreateVolumesFromImageTest-1616363142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b6fff168-9ee8-4b24-97d8-fd3382437ab2 1073741824" returned: 0 in 1.268s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2995bf9f-6e7e-4e01-89c0-3075c0b0837e tempest-CreateVolumesFromImageTest-1616363142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b6fff168-9ee8-4b24-97d8-fd3382437ab2 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:15 devstack sudo[88002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b6fff168-9ee8-4b24-97d8-fd3382437ab2 Apr 28 19:17:15 devstack sudo[88002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:16 devstack sudo[88002]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2995bf9f-6e7e-4e01-89c0-3075c0b0837e tempest-CreateVolumesFromImageTest-1616363142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b6fff168-9ee8-4b24-97d8-fd3382437ab2" returned: 0 in 0.778s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:16 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2995bf9f-6e7e-4e01-89c0-3075c0b0837e tempest-CreateVolumesFromImageTest-1616363142 None] <== create_volume: return (2132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:17:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2995bf9f-6e7e-4e01-89c0-3075c0b0837e tempest-CreateVolumesFromImageTest-1616363142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.134s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:17:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-722e413b-f28d-4715-9611-2a11266d2cb5 tempest-SnapshotsActionsTest-904821522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.541s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:17:16 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-722e413b-f28d-4715-9611-2a11266d2cb5 tempest-SnapshotsActionsTest-904821522 None] Creating offline snapshot 99daf0b3-8f01-4669-b9c3-5e1680b5ebda of volume da601bc0-f975-4bd3-8926-4b6098299f9d {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 19:17:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2995bf9f-6e7e-4e01-89c0-3075c0b0837e tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a8a26b8-49db-4861-bba7-e4ee4334d009) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6fff168-9ee8-4b24-97d8-fd3382437ab2', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2995bf9f-6e7e-4e01-89c0-3075c0b0837e tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52bcf66d-5b60-496b-bac5-4488102f4eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:16 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[23685c99-39b2-4a60-9326-de29e33556d2]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:17:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-722e413b-f28d-4715-9611-2a11266d2cb5 tempest-SnapshotsActionsTest-904821522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:16 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-2995bf9f-6e7e-4e01-89c0-3075c0b0837e tempest-CreateVolumesFromImageTest-1616363142 None] Volume volume-b6fff168-9ee8-4b24-97d8-fd3382437ab2 (b6fff168-9ee8-4b24-97d8-fd3382437ab2): created successfully Apr 28 19:17:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2995bf9f-6e7e-4e01-89c0-3075c0b0837e tempest-CreateVolumesFromImageTest-1616363142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52bcf66d-5b60-496b-bac5-4488102f4eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2995bf9f-6e7e-4e01-89c0-3075c0b0837e tempest-CreateVolumesFromImageTest-1616363142 None] Flow 'volume_create_manager' (65eb285f-b104-4539-8b2a-d4e37fe0ebcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:17:16 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-2995bf9f-6e7e-4e01-89c0-3075c0b0837e tempest-CreateVolumesFromImageTest-1616363142 None] Created volume successfully. Apr 28 19:17:16 devstack sudo[88008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe Apr 28 19:17:16 devstack sudo[88008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:17 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c182200d-2daa-4a62-b40e-ffb160baf788 tempest-CreateVolumesFromImageTest-1616363142 None] Acquiring lock "cinder-b6fff168-9ee8-4b24-97d8-fd3382437ab2-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:17:17 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c182200d-2daa-4a62-b40e-ffb160baf788 tempest-CreateVolumesFromImageTest-1616363142 None] Lock "cinder-b6fff168-9ee8-4b24-97d8-fd3382437ab2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:17:17 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c182200d-2daa-4a62-b40e-ffb160baf788 tempest-CreateVolumesFromImageTest-1616363142 None] Acquiring lock "cinder-quobyte-b6fff168-9ee8-4b24-97d8-fd3382437ab2" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:17:17 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c182200d-2daa-4a62-b40e-ffb160baf788 tempest-CreateVolumesFromImageTest-1616363142 None] Lock "cinder-quobyte-b6fff168-9ee8-4b24-97d8-fd3382437ab2" acquired by "delete_volume" :: waited 0.032s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:17:17 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[08071f07-8561-4e17-b23b-62f28fc5a633]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:17:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c182200d-2daa-4a62-b40e-ffb160baf788 tempest-CreateVolumesFromImageTest-1616363142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b6fff168-9ee8-4b24-97d8-fd3382437ab2 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:17 devstack sudo[88008]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-722e413b-f28d-4715-9611-2a11266d2cb5 tempest-SnapshotsActionsTest-904821522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe" returned: 0 in 0.983s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-722e413b-f28d-4715-9611-2a11266d2cb5 tempest-SnapshotsActionsTest-904821522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da601bc0-f975-4bd3-8926-4b6098299f9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:17:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-722e413b-f28d-4715-9611-2a11266d2cb5 tempest-SnapshotsActionsTest-904821522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.99daf0b3-8f01-4669-b9c3-5e1680b5ebda 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:17 devstack sudo[88015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.99daf0b3-8f01-4669-b9c3-5e1680b5ebda 1G Apr 28 19:17:17 devstack sudo[88015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:17 devstack sudo[88014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b6fff168-9ee8-4b24-97d8-fd3382437ab2 Apr 28 19:17:17 devstack sudo[88014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:18 devstack sudo[88014]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c182200d-2daa-4a62-b40e-ffb160baf788 tempest-CreateVolumesFromImageTest-1616363142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b6fff168-9ee8-4b24-97d8-fd3382437ab2" returned: 0 in 0.807s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c182200d-2daa-4a62-b40e-ffb160baf788 tempest-CreateVolumesFromImageTest-1616363142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b6fff168-9ee8-4b24-97d8-fd3382437ab2 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:18 devstack sudo[88026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b6fff168-9ee8-4b24-97d8-fd3382437ab2 Apr 28 19:17:18 devstack sudo[88026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:18 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-f71f2752-37bb-4899-ae9d-6d2e14571a7c tempest-SnapshotMetadataTestJSON-199548848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:17:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f71f2752-37bb-4899-ae9d-6d2e14571a7c tempest-SnapshotMetadataTestJSON-199548848 None] Flow 'volume_create_manager' (5bead544-b68c-4818-a2ab-6f305061870f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:17:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f71f2752-37bb-4899-ae9d-6d2e14571a7c tempest-SnapshotMetadataTestJSON-199548848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d36deb2e-ddd3-4ef9-b34b-9ac74f980479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f71f2752-37bb-4899-ae9d-6d2e14571a7c tempest-SnapshotMetadataTestJSON-199548848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d36deb2e-ddd3-4ef9-b34b-9ac74f980479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:17:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-626159498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08938e0c-b4d2-4557-8179-a95a70fbce0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a0d2c0fe8614cc5864d0f0a7903afbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:17:18Z,use_quota=True,user_id='ff41fadf1f4a4493a8b132aa4091dca4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f71f2752-37bb-4899-ae9d-6d2e14571a7c tempest-SnapshotMetadataTestJSON-199548848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9634153-467b-4907-9f3b-6b0e33770338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f71f2752-37bb-4899-ae9d-6d2e14571a7c tempest-SnapshotMetadataTestJSON-199548848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9634153-467b-4907-9f3b-6b0e33770338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f71f2752-37bb-4899-ae9d-6d2e14571a7c tempest-SnapshotMetadataTestJSON-199548848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05efb391-7733-4115-a837-93aa607aed42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f71f2752-37bb-4899-ae9d-6d2e14571a7c tempest-SnapshotMetadataTestJSON-199548848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05efb391-7733-4115-a837-93aa607aed42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08938e0c-b4d2-4557-8179-a95a70fbce0d', 'volume_name': 'volume-08938e0c-b4d2-4557-8179-a95a70fbce0d', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f71f2752-37bb-4899-ae9d-6d2e14571a7c tempest-SnapshotMetadataTestJSON-199548848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d103fa50-c4a3-47f4-aa8c-c838636db033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:18 devstack sudo[88015]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f71f2752-37bb-4899-ae9d-6d2e14571a7c tempest-SnapshotMetadataTestJSON-199548848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d103fa50-c4a3-47f4-aa8c-c838636db033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f71f2752-37bb-4899-ae9d-6d2e14571a7c tempest-SnapshotMetadataTestJSON-199548848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (204d9334-94bf-4957-82c2-7e267b0a8e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:18 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-f71f2752-37bb-4899-ae9d-6d2e14571a7c tempest-SnapshotMetadataTestJSON-199548848 None] Volume 08938e0c-b4d2-4557-8179-a95a70fbce0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08938e0c-b4d2-4557-8179-a95a70fbce0d', 'volume_size': 1} Apr 28 19:17:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f71f2752-37bb-4899-ae9d-6d2e14571a7c tempest-SnapshotMetadataTestJSON-199548848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:17:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-722e413b-f28d-4715-9611-2a11266d2cb5 tempest-SnapshotsActionsTest-904821522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.99daf0b3-8f01-4669-b9c3-5e1680b5ebda 1G" returned: 0 in 1.003s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-722e413b-f28d-4715-9611-2a11266d2cb5 tempest-SnapshotsActionsTest-904821522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.99daf0b3-8f01-4669-b9c3-5e1680b5ebda {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:18 devstack sudo[88028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.99daf0b3-8f01-4669-b9c3-5e1680b5ebda Apr 28 19:17:18 devstack sudo[88028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:19 devstack sudo[88026]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c182200d-2daa-4a62-b40e-ffb160baf788 tempest-CreateVolumesFromImageTest-1616363142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b6fff168-9ee8-4b24-97d8-fd3382437ab2" returned: 0 in 0.783s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:19 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c182200d-2daa-4a62-b40e-ffb160baf788 tempest-CreateVolumesFromImageTest-1616363142 None] Lock "cinder-quobyte-b6fff168-9ee8-4b24-97d8-fd3382437ab2" released by "delete_volume" :: held 1.673s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:17:19 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-c182200d-2daa-4a62-b40e-ffb160baf788 tempest-CreateVolumesFromImageTest-1616363142 None] Created reservations ['574a5aff-c8d0-4523-8562-89b0cc78ae0c', 'e7d9b255-ad06-40b6-abcb-bab79d1306b6', '5de77007-1628-46b5-8f3d-81f7add5900c', '6268aedf-2e28-4d9a-a8fc-3d75c62ed32d'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:17:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c182200d-2daa-4a62-b40e-ffb160baf788 tempest-CreateVolumesFromImageTest-1616363142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:17:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c182200d-2daa-4a62-b40e-ffb160baf788 tempest-CreateVolumesFromImageTest-1616363142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:17:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c182200d-2daa-4a62-b40e-ffb160baf788 tempest-CreateVolumesFromImageTest-1616363142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:17:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c182200d-2daa-4a62-b40e-ffb160baf788 tempest-CreateVolumesFromImageTest-1616363142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:17:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c182200d-2daa-4a62-b40e-ffb160baf788 tempest-CreateVolumesFromImageTest-1616363142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:17:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c182200d-2daa-4a62-b40e-ffb160baf788 tempest-CreateVolumesFromImageTest-1616363142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:19 devstack sudo[88034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:17:19 devstack sudo[88034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:19 devstack sudo[88028]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-722e413b-f28d-4715-9611-2a11266d2cb5 tempest-SnapshotsActionsTest-904821522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.99daf0b3-8f01-4669-b9c3-5e1680b5ebda" returned: 0 in 0.814s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:19 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-722e413b-f28d-4715-9611-2a11266d2cb5 tempest-SnapshotsActionsTest-904821522 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.99daf0b3-8f01-4669-b9c3-5e1680b5ebda is being set with open permissions: ugo+rw Apr 28 19:17:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-722e413b-f28d-4715-9611-2a11266d2cb5 tempest-SnapshotsActionsTest-904821522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.99daf0b3-8f01-4669-b9c3-5e1680b5ebda {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:19 devstack sudo[88036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.99daf0b3-8f01-4669-b9c3-5e1680b5ebda Apr 28 19:17:19 devstack sudo[88036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:19 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2888ae71-01dc-4bfc-b373-266805894039 tempest-CreateVolumesFromImageTest-1616363142 None] Acquiring lock "cinder-cf447c7a-c083-420d-8e51-53c0f29263e9-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:17:19 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2888ae71-01dc-4bfc-b373-266805894039 tempest-CreateVolumesFromImageTest-1616363142 None] Lock "cinder-cf447c7a-c083-420d-8e51-53c0f29263e9-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:17:19 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2888ae71-01dc-4bfc-b373-266805894039 tempest-CreateVolumesFromImageTest-1616363142 None] Acquiring lock "cinder-quobyte-cf447c7a-c083-420d-8e51-53c0f29263e9" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:17:19 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2888ae71-01dc-4bfc-b373-266805894039 tempest-CreateVolumesFromImageTest-1616363142 None] Lock "cinder-quobyte-cf447c7a-c083-420d-8e51-53c0f29263e9" acquired by "delete_volume" :: waited 0.020s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:17:19 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac1275d-29bf-4799-bd17-2d4085d1088b]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:17:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2888ae71-01dc-4bfc-b373-266805894039 tempest-CreateVolumesFromImageTest-1616363142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cf447c7a-c083-420d-8e51-53c0f29263e9 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:19 devstack sudo[88038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cf447c7a-c083-420d-8e51-53c0f29263e9 Apr 28 19:17:19 devstack sudo[88038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:20 devstack sudo[88036]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-722e413b-f28d-4715-9611-2a11266d2cb5 tempest-SnapshotsActionsTest-904821522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.99daf0b3-8f01-4669-b9c3-5e1680b5ebda" returned: 0 in 0.688s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-722e413b-f28d-4715-9611-2a11266d2cb5 tempest-SnapshotsActionsTest-904821522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.626s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:17:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f71f2752-37bb-4899-ae9d-6d2e14571a7c tempest-SnapshotMetadataTestJSON-199548848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.555s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:17:20 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f71f2752-37bb-4899-ae9d-6d2e14571a7c tempest-SnapshotMetadataTestJSON-199548848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:17:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-626159498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08938e0c-b4d2-4557-8179-a95a70fbce0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a0d2c0fe8614cc5864d0f0a7903afbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:17:18Z,use_quota=True,user_id='ff41fadf1f4a4493a8b132aa4091dca4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:17:20 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-f71f2752-37bb-4899-ae9d-6d2e14571a7c tempest-SnapshotMetadataTestJSON-199548848 None] Creating volume 08938e0c-b4d2-4557-8179-a95a70fbce0d {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:17:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f71f2752-37bb-4899-ae9d-6d2e14571a7c tempest-SnapshotMetadataTestJSON-199548848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:17:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f71f2752-37bb-4899-ae9d-6d2e14571a7c tempest-SnapshotMetadataTestJSON-199548848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:17:20 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f71f2752-37bb-4899-ae9d-6d2e14571a7c tempest-SnapshotMetadataTestJSON-199548848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:17:20 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f71f2752-37bb-4899-ae9d-6d2e14571a7c tempest-SnapshotMetadataTestJSON-199548848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:17:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f71f2752-37bb-4899-ae9d-6d2e14571a7c tempest-SnapshotMetadataTestJSON-199548848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:17:20 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f71f2752-37bb-4899-ae9d-6d2e14571a7c tempest-SnapshotMetadataTestJSON-199548848 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:17:20 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-f71f2752-37bb-4899-ae9d-6d2e14571a7c tempest-SnapshotMetadataTestJSON-199548848 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:17:20 devstack sudo[88034]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f71f2752-37bb-4899-ae9d-6d2e14571a7c tempest-SnapshotMetadataTestJSON-199548848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-08938e0c-b4d2-4557-8179-a95a70fbce0d 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c182200d-2daa-4a62-b40e-ffb160baf788 tempest-CreateVolumesFromImageTest-1616363142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.888s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:20 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-c182200d-2daa-4a62-b40e-ffb160baf788 tempest-CreateVolumesFromImageTest-1616363142 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:17:20 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-c182200d-2daa-4a62-b40e-ffb160baf788 tempest-CreateVolumesFromImageTest-1616363142 None] Deleted volume successfully. Apr 28 19:17:20 devstack sudo[88043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-08938e0c-b4d2-4557-8179-a95a70fbce0d 1073741824 Apr 28 19:17:20 devstack sudo[88043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:20 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-722e413b-f28d-4715-9611-2a11266d2cb5 tempest-SnapshotsActionsTest-904821522 None] Create snapshot completed successfully Apr 28 19:17:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c182200d-2daa-4a62-b40e-ffb160baf788 tempest-CreateVolumesFromImageTest-1616363142 None] Lock "cinder-b6fff168-9ee8-4b24-97d8-fd3382437ab2-delete_volume" released by "delete_volume" :: held 2.855s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:17:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-63652227-0c26-4e04-af5c-31182af4222a tempest-SnapshotsActionsTest-189624283 None] Acquiring lock "cinder-99daf0b3-8f01-4669-b9c3-5e1680b5ebda-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:17:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-63652227-0c26-4e04-af5c-31182af4222a tempest-SnapshotsActionsTest-189624283 None] Lock "cinder-99daf0b3-8f01-4669-b9c3-5e1680b5ebda-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:17:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-63652227-0c26-4e04-af5c-31182af4222a tempest-SnapshotsActionsTest-189624283 None] Acquiring lock "cinder-quobyte-da601bc0-f975-4bd3-8926-4b6098299f9d" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:17:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-63652227-0c26-4e04-af5c-31182af4222a tempest-SnapshotsActionsTest-189624283 None] Lock "cinder-quobyte-da601bc0-f975-4bd3-8926-4b6098299f9d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:17:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-63652227-0c26-4e04-af5c-31182af4222a tempest-SnapshotsActionsTest-189624283 None] Acquiring lock "cinder-quobyte-99daf0b3-8f01-4669-b9c3-5e1680b5ebda" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:17:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-63652227-0c26-4e04-af5c-31182af4222a tempest-SnapshotsActionsTest-189624283 None] Lock "cinder-quobyte-99daf0b3-8f01-4669-b9c3-5e1680b5ebda" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:17:20 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-63652227-0c26-4e04-af5c-31182af4222a tempest-SnapshotsActionsTest-189624283 None] Deleting offline snapshot 99daf0b3-8f01-4669-b9c3-5e1680b5ebda of volume da601bc0-f975-4bd3-8926-4b6098299f9d {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 19:17:20 devstack sudo[88038]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:20 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-63652227-0c26-4e04-af5c-31182af4222a tempest-SnapshotsActionsTest-189624283 None] snapshot_file for this snap is: volume-da601bc0-f975-4bd3-8926-4b6098299f9d.99daf0b3-8f01-4669-b9c3-5e1680b5ebda {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 19:17:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2888ae71-01dc-4bfc-b373-266805894039 tempest-CreateVolumesFromImageTest-1616363142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cf447c7a-c083-420d-8e51-53c0f29263e9" returned: 0 in 0.871s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2888ae71-01dc-4bfc-b373-266805894039 tempest-CreateVolumesFromImageTest-1616363142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cf447c7a-c083-420d-8e51-53c0f29263e9 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:20 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e1c2ed-d8c5-4bf5-9bcb-1b1b1e48409e]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:17:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-63652227-0c26-4e04-af5c-31182af4222a tempest-SnapshotsActionsTest-189624283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.99daf0b3-8f01-4669-b9c3-5e1680b5ebda {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:20 devstack sudo[88050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cf447c7a-c083-420d-8e51-53c0f29263e9 Apr 28 19:17:20 devstack sudo[88050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:20 devstack sudo[88051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.99daf0b3-8f01-4669-b9c3-5e1680b5ebda Apr 28 19:17:20 devstack sudo[88051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:21 devstack sudo[88043]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f71f2752-37bb-4899-ae9d-6d2e14571a7c tempest-SnapshotMetadataTestJSON-199548848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-08938e0c-b4d2-4557-8179-a95a70fbce0d 1073741824" returned: 0 in 0.945s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f71f2752-37bb-4899-ae9d-6d2e14571a7c tempest-SnapshotMetadataTestJSON-199548848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-08938e0c-b4d2-4557-8179-a95a70fbce0d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:21 devstack sudo[88058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-08938e0c-b4d2-4557-8179-a95a70fbce0d Apr 28 19:17:21 devstack sudo[88058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:21 devstack sudo[88050]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2888ae71-01dc-4bfc-b373-266805894039 tempest-CreateVolumesFromImageTest-1616363142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cf447c7a-c083-420d-8e51-53c0f29263e9" returned: 0 in 0.763s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:21 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2888ae71-01dc-4bfc-b373-266805894039 tempest-CreateVolumesFromImageTest-1616363142 None] Lock "cinder-quobyte-cf447c7a-c083-420d-8e51-53c0f29263e9" released by "delete_volume" :: held 1.696s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:17:21 devstack sudo[88051]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:21 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-2888ae71-01dc-4bfc-b373-266805894039 tempest-CreateVolumesFromImageTest-1616363142 None] Created reservations ['aefeb553-a104-44c9-a75b-f4e7e3ccd637', '55470b3f-47fb-4237-afbf-ec562fd556dc', '5a8ec54d-459c-4966-9ee0-515cbd93d454', 'd63d2585-3c7a-4c93-91f4-f306485346fc'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:17:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-63652227-0c26-4e04-af5c-31182af4222a tempest-SnapshotsActionsTest-189624283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.99daf0b3-8f01-4669-b9c3-5e1680b5ebda" returned: 0 in 0.834s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:21 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-63652227-0c26-4e04-af5c-31182af4222a tempest-SnapshotsActionsTest-189624283 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da601bc0-f975-4bd3-8926-4b6098299f9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:17:21 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58e8d13-190b-4384-923e-cb7b13f0e417]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:17:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-63652227-0c26-4e04-af5c-31182af4222a tempest-SnapshotsActionsTest-189624283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2888ae71-01dc-4bfc-b373-266805894039 tempest-CreateVolumesFromImageTest-1616363142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:17:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2888ae71-01dc-4bfc-b373-266805894039 tempest-CreateVolumesFromImageTest-1616363142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:17:21 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2888ae71-01dc-4bfc-b373-266805894039 tempest-CreateVolumesFromImageTest-1616363142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:17:21 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2888ae71-01dc-4bfc-b373-266805894039 tempest-CreateVolumesFromImageTest-1616363142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:17:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2888ae71-01dc-4bfc-b373-266805894039 tempest-CreateVolumesFromImageTest-1616363142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:17:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2888ae71-01dc-4bfc-b373-266805894039 tempest-CreateVolumesFromImageTest-1616363142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:21 devstack sudo[88066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:17:21 devstack sudo[88066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:21 devstack sudo[88064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe Apr 28 19:17:21 devstack sudo[88064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:21 devstack sudo[88058]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f71f2752-37bb-4899-ae9d-6d2e14571a7c tempest-SnapshotMetadataTestJSON-199548848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-08938e0c-b4d2-4557-8179-a95a70fbce0d" returned: 0 in 0.679s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:21 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f71f2752-37bb-4899-ae9d-6d2e14571a7c tempest-SnapshotMetadataTestJSON-199548848 None] <== create_volume: return (1674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:17:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f71f2752-37bb-4899-ae9d-6d2e14571a7c tempest-SnapshotMetadataTestJSON-199548848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.677s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:17:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f71f2752-37bb-4899-ae9d-6d2e14571a7c tempest-SnapshotMetadataTestJSON-199548848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (204d9334-94bf-4957-82c2-7e267b0a8e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08938e0c-b4d2-4557-8179-a95a70fbce0d', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f71f2752-37bb-4899-ae9d-6d2e14571a7c tempest-SnapshotMetadataTestJSON-199548848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (411172f4-4196-4c44-8685-f5dfbd283add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:21 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-f71f2752-37bb-4899-ae9d-6d2e14571a7c tempest-SnapshotMetadataTestJSON-199548848 None] Volume volume-08938e0c-b4d2-4557-8179-a95a70fbce0d (08938e0c-b4d2-4557-8179-a95a70fbce0d): created successfully Apr 28 19:17:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f71f2752-37bb-4899-ae9d-6d2e14571a7c tempest-SnapshotMetadataTestJSON-199548848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (411172f4-4196-4c44-8685-f5dfbd283add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f71f2752-37bb-4899-ae9d-6d2e14571a7c tempest-SnapshotMetadataTestJSON-199548848 None] Flow 'volume_create_manager' (5bead544-b68c-4818-a2ab-6f305061870f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:17:21 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-f71f2752-37bb-4899-ae9d-6d2e14571a7c tempest-SnapshotMetadataTestJSON-199548848 None] Created volume successfully. Apr 28 19:17:21 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3f650684-4a9a-4441-8b23-a981f951fdbe tempest-CreateVolumesFromImageTest-1616363142 None] Acquiring lock "cinder-bfec46df-cea0-41c3-b5f9-42372753836c-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:17:22 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3f650684-4a9a-4441-8b23-a981f951fdbe tempest-CreateVolumesFromImageTest-1616363142 None] Lock "cinder-bfec46df-cea0-41c3-b5f9-42372753836c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:17:22 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3f650684-4a9a-4441-8b23-a981f951fdbe tempest-CreateVolumesFromImageTest-1616363142 None] Acquiring lock "cinder-quobyte-bfec46df-cea0-41c3-b5f9-42372753836c" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:17:22 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3f650684-4a9a-4441-8b23-a981f951fdbe tempest-CreateVolumesFromImageTest-1616363142 None] Lock "cinder-quobyte-bfec46df-cea0-41c3-b5f9-42372753836c" acquired by "delete_volume" :: waited 0.027s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:17:22 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43d043d-ad9a-4f6f-ae52-4477664a0cff]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:17:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3f650684-4a9a-4441-8b23-a981f951fdbe tempest-CreateVolumesFromImageTest-1616363142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bfec46df-cea0-41c3-b5f9-42372753836c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:22 devstack sudo[88069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bfec46df-cea0-41c3-b5f9-42372753836c Apr 28 19:17:22 devstack sudo[88069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:22 devstack sudo[88066]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2888ae71-01dc-4bfc-b373-266805894039 tempest-CreateVolumesFromImageTest-1616363142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.649s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:22 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-2888ae71-01dc-4bfc-b373-266805894039 tempest-CreateVolumesFromImageTest-1616363142 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:17:22 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-2888ae71-01dc-4bfc-b373-266805894039 tempest-CreateVolumesFromImageTest-1616363142 None] Deleted volume successfully. Apr 28 19:17:22 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2888ae71-01dc-4bfc-b373-266805894039 tempest-CreateVolumesFromImageTest-1616363142 None] Lock "cinder-cf447c7a-c083-420d-8e51-53c0f29263e9-delete_volume" released by "delete_volume" :: held 2.708s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:17:22 devstack sudo[88064]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-63652227-0c26-4e04-af5c-31182af4222a tempest-SnapshotsActionsTest-189624283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe" returned: 0 in 0.868s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:22 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-63652227-0c26-4e04-af5c-31182af4222a tempest-SnapshotsActionsTest-189624283 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da601bc0-f975-4bd3-8926-4b6098299f9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:17:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-63652227-0c26-4e04-af5c-31182af4222a tempest-SnapshotsActionsTest-189624283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.99daf0b3-8f01-4669-b9c3-5e1680b5ebda {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:22 devstack sudo[88075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.99daf0b3-8f01-4669-b9c3-5e1680b5ebda Apr 28 19:17:22 devstack sudo[88075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:22 devstack sudo[88069]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3f650684-4a9a-4441-8b23-a981f951fdbe tempest-CreateVolumesFromImageTest-1616363142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bfec46df-cea0-41c3-b5f9-42372753836c" returned: 0 in 0.777s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3f650684-4a9a-4441-8b23-a981f951fdbe tempest-CreateVolumesFromImageTest-1616363142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bfec46df-cea0-41c3-b5f9-42372753836c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:22 devstack sudo[88080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bfec46df-cea0-41c3-b5f9-42372753836c Apr 28 19:17:22 devstack sudo[88080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b584cc7b-28ab-4857-8684-bcbb13f6e5b9 tempest-SnapshotMetadataTestJSON-199548848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:17:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b584cc7b-28ab-4857-8684-bcbb13f6e5b9 tempest-SnapshotMetadataTestJSON-199548848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:17:23 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-b584cc7b-28ab-4857-8684-bcbb13f6e5b9 tempest-SnapshotMetadataTestJSON-199548848 None] Creating offline snapshot 1dc63892-f9ea-4593-841e-690a71014c30 of volume 08938e0c-b4d2-4557-8179-a95a70fbce0d {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 19:17:23 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f5afe6-0dbe-41ad-a901-a31493c5cc01]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:17:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b584cc7b-28ab-4857-8684-bcbb13f6e5b9 tempest-SnapshotMetadataTestJSON-199548848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-08938e0c-b4d2-4557-8179-a95a70fbce0d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:23 devstack sudo[88084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-08938e0c-b4d2-4557-8179-a95a70fbce0d Apr 28 19:17:23 devstack sudo[88084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:23 devstack sudo[88075]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-63652227-0c26-4e04-af5c-31182af4222a tempest-SnapshotsActionsTest-189624283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.99daf0b3-8f01-4669-b9c3-5e1680b5ebda" returned: 0 in 0.854s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-63652227-0c26-4e04-af5c-31182af4222a tempest-SnapshotsActionsTest-189624283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.99daf0b3-8f01-4669-b9c3-5e1680b5ebda {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:23 devstack sudo[88087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.99daf0b3-8f01-4669-b9c3-5e1680b5ebda Apr 28 19:17:23 devstack sudo[88087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:23 devstack sudo[88080]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3f650684-4a9a-4441-8b23-a981f951fdbe tempest-CreateVolumesFromImageTest-1616363142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bfec46df-cea0-41c3-b5f9-42372753836c" returned: 0 in 0.748s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:23 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3f650684-4a9a-4441-8b23-a981f951fdbe tempest-CreateVolumesFromImageTest-1616363142 None] Lock "cinder-quobyte-bfec46df-cea0-41c3-b5f9-42372753836c" released by "delete_volume" :: held 1.577s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:17:23 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-3f650684-4a9a-4441-8b23-a981f951fdbe tempest-CreateVolumesFromImageTest-1616363142 None] Created reservations ['38f4e1ad-218d-40ad-8d84-d5c498defb05', 'e2d34d77-599f-44e4-b298-199333070a83', '80e2dfe8-1816-4344-b33b-bfdca4cd020b', 'fcf0f7cd-ad4a-437b-96f7-76e756983f6e'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:17:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3f650684-4a9a-4441-8b23-a981f951fdbe tempest-CreateVolumesFromImageTest-1616363142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:17:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3f650684-4a9a-4441-8b23-a981f951fdbe tempest-CreateVolumesFromImageTest-1616363142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:17:23 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3f650684-4a9a-4441-8b23-a981f951fdbe tempest-CreateVolumesFromImageTest-1616363142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:17:23 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3f650684-4a9a-4441-8b23-a981f951fdbe tempest-CreateVolumesFromImageTest-1616363142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:17:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3f650684-4a9a-4441-8b23-a981f951fdbe tempest-CreateVolumesFromImageTest-1616363142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:17:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3f650684-4a9a-4441-8b23-a981f951fdbe tempest-CreateVolumesFromImageTest-1616363142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:23 devstack sudo[88126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:17:23 devstack sudo[88126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:24 devstack sudo[88084]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b584cc7b-28ab-4857-8684-bcbb13f6e5b9 tempest-SnapshotMetadataTestJSON-199548848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-08938e0c-b4d2-4557-8179-a95a70fbce0d" returned: 0 in 1.012s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b584cc7b-28ab-4857-8684-bcbb13f6e5b9 tempest-SnapshotMetadataTestJSON-199548848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-08938e0c-b4d2-4557-8179-a95a70fbce0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-08938e0c-b4d2-4557-8179-a95a70fbce0d.1dc63892-f9ea-4593-841e-690a71014c30 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:24 devstack sudo[88130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-08938e0c-b4d2-4557-8179-a95a70fbce0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-08938e0c-b4d2-4557-8179-a95a70fbce0d.1dc63892-f9ea-4593-841e-690a71014c30 1G Apr 28 19:17:24 devstack sudo[88130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:24 devstack sudo[88087]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-63652227-0c26-4e04-af5c-31182af4222a tempest-SnapshotsActionsTest-189624283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.99daf0b3-8f01-4669-b9c3-5e1680b5ebda" returned: 0 in 0.953s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:24 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-65049c76-e43e-48f3-9116-8bc34551875d tempest-CreateVolumesFromImageTest-1616363142 None] Acquiring lock "cinder-6eebd926-0d33-44b7-b6eb-7da14299e30d-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:17:24 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-63652227-0c26-4e04-af5c-31182af4222a tempest-SnapshotsActionsTest-189624283 None] Lock "cinder-quobyte-99daf0b3-8f01-4669-b9c3-5e1680b5ebda" released by "_delete_snapshot" :: held 3.666s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:17:24 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-63652227-0c26-4e04-af5c-31182af4222a tempest-SnapshotsActionsTest-189624283 None] Lock "cinder-quobyte-da601bc0-f975-4bd3-8926-4b6098299f9d" released by "delete_snapshot" :: held 3.701s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:17:24 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-65049c76-e43e-48f3-9116-8bc34551875d tempest-CreateVolumesFromImageTest-1616363142 None] Lock "cinder-6eebd926-0d33-44b7-b6eb-7da14299e30d-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:17:24 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-65049c76-e43e-48f3-9116-8bc34551875d tempest-CreateVolumesFromImageTest-1616363142 None] Acquiring lock "cinder-quobyte-6eebd926-0d33-44b7-b6eb-7da14299e30d" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:17:24 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-63652227-0c26-4e04-af5c-31182af4222a tempest-SnapshotsActionsTest-189624283 None] Created reservations ['99448582-125a-4f1f-b997-89761ec889a1', 'c6f20174-2726-4c4b-9ab6-64d94275f908', '92d3f4af-6789-47a1-b08d-5553115d3d45', '8550b2a4-d506-4610-8b22-6852375af6ff'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:17:24 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-65049c76-e43e-48f3-9116-8bc34551875d tempest-CreateVolumesFromImageTest-1616363142 None] Lock "cinder-quobyte-6eebd926-0d33-44b7-b6eb-7da14299e30d" acquired by "delete_volume" :: waited 0.040s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:17:24 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3180d1c3-0bfe-4d25-8400-6d87244dbb50]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:17:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-65049c76-e43e-48f3-9116-8bc34551875d tempest-CreateVolumesFromImageTest-1616363142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6eebd926-0d33-44b7-b6eb-7da14299e30d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:24 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-63652227-0c26-4e04-af5c-31182af4222a tempest-SnapshotsActionsTest-189624283 None] Delete snapshot completed successfully. Apr 28 19:17:24 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-63652227-0c26-4e04-af5c-31182af4222a tempest-SnapshotsActionsTest-189624283 None] Lock "cinder-99daf0b3-8f01-4669-b9c3-5e1680b5ebda-delete_snapshot" released by "delete_snapshot" :: held 4.017s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:17:24 devstack sudo[88133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6eebd926-0d33-44b7-b6eb-7da14299e30d Apr 28 19:17:24 devstack sudo[88133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:24 devstack sudo[88126]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3f650684-4a9a-4441-8b23-a981f951fdbe tempest-CreateVolumesFromImageTest-1616363142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.909s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:24 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-3f650684-4a9a-4441-8b23-a981f951fdbe tempest-CreateVolumesFromImageTest-1616363142 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:17:24 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-3f650684-4a9a-4441-8b23-a981f951fdbe tempest-CreateVolumesFromImageTest-1616363142 None] Deleted volume successfully. Apr 28 19:17:24 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3f650684-4a9a-4441-8b23-a981f951fdbe tempest-CreateVolumesFromImageTest-1616363142 None] Lock "cinder-bfec46df-cea0-41c3-b5f9-42372753836c-delete_volume" released by "delete_volume" :: held 2.889s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:17:25 devstack sudo[88130]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b584cc7b-28ab-4857-8684-bcbb13f6e5b9 tempest-SnapshotMetadataTestJSON-199548848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-08938e0c-b4d2-4557-8179-a95a70fbce0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-08938e0c-b4d2-4557-8179-a95a70fbce0d.1dc63892-f9ea-4593-841e-690a71014c30 1G" returned: 0 in 1.085s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b584cc7b-28ab-4857-8684-bcbb13f6e5b9 tempest-SnapshotMetadataTestJSON-199548848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08938e0c-b4d2-4557-8179-a95a70fbce0d -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-08938e0c-b4d2-4557-8179-a95a70fbce0d.1dc63892-f9ea-4593-841e-690a71014c30 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:25 devstack sudo[88140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08938e0c-b4d2-4557-8179-a95a70fbce0d -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-08938e0c-b4d2-4557-8179-a95a70fbce0d.1dc63892-f9ea-4593-841e-690a71014c30 Apr 28 19:17:25 devstack sudo[88140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-25f4bcc9-f061-4f72-b669-b47fc429633a tempest-SnapshotsActionsTest-904821522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:17:25 devstack sudo[88133]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-65049c76-e43e-48f3-9116-8bc34551875d tempest-CreateVolumesFromImageTest-1616363142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6eebd926-0d33-44b7-b6eb-7da14299e30d" returned: 0 in 1.056s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-65049c76-e43e-48f3-9116-8bc34551875d tempest-CreateVolumesFromImageTest-1616363142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6eebd926-0d33-44b7-b6eb-7da14299e30d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:25 devstack sudo[88145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6eebd926-0d33-44b7-b6eb-7da14299e30d Apr 28 19:17:25 devstack sudo[88145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:25 devstack sudo[88140]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b584cc7b-28ab-4857-8684-bcbb13f6e5b9 tempest-SnapshotMetadataTestJSON-199548848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08938e0c-b4d2-4557-8179-a95a70fbce0d -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-08938e0c-b4d2-4557-8179-a95a70fbce0d.1dc63892-f9ea-4593-841e-690a71014c30" returned: 0 in 0.825s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:25 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-b584cc7b-28ab-4857-8684-bcbb13f6e5b9 tempest-SnapshotMetadataTestJSON-199548848 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-08938e0c-b4d2-4557-8179-a95a70fbce0d.1dc63892-f9ea-4593-841e-690a71014c30 is being set with open permissions: ugo+rw Apr 28 19:17:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b584cc7b-28ab-4857-8684-bcbb13f6e5b9 tempest-SnapshotMetadataTestJSON-199548848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-08938e0c-b4d2-4557-8179-a95a70fbce0d.1dc63892-f9ea-4593-841e-690a71014c30 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:25 devstack sudo[88150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-08938e0c-b4d2-4557-8179-a95a70fbce0d.1dc63892-f9ea-4593-841e-690a71014c30 Apr 28 19:17:25 devstack sudo[88150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:26 devstack sudo[88145]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-65049c76-e43e-48f3-9116-8bc34551875d tempest-CreateVolumesFromImageTest-1616363142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6eebd926-0d33-44b7-b6eb-7da14299e30d" returned: 0 in 0.872s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:26 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-65049c76-e43e-48f3-9116-8bc34551875d tempest-CreateVolumesFromImageTest-1616363142 None] Lock "cinder-quobyte-6eebd926-0d33-44b7-b6eb-7da14299e30d" released by "delete_volume" :: held 1.978s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:17:26 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-65049c76-e43e-48f3-9116-8bc34551875d tempest-CreateVolumesFromImageTest-1616363142 None] Created reservations ['314baa9e-7fd8-4aa0-9b91-4d18821d6a74', 'cafe39e0-48f4-43cd-9264-b67a0299a8bc', 'd6b29565-98ef-4715-a68e-c954d8696911', '298be3c2-98cd-4532-946f-5a9ab1779eb4'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:17:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-65049c76-e43e-48f3-9116-8bc34551875d tempest-CreateVolumesFromImageTest-1616363142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:17:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-65049c76-e43e-48f3-9116-8bc34551875d tempest-CreateVolumesFromImageTest-1616363142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:17:26 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-65049c76-e43e-48f3-9116-8bc34551875d tempest-CreateVolumesFromImageTest-1616363142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:17:26 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-65049c76-e43e-48f3-9116-8bc34551875d tempest-CreateVolumesFromImageTest-1616363142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:17:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-65049c76-e43e-48f3-9116-8bc34551875d tempest-CreateVolumesFromImageTest-1616363142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:17:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-65049c76-e43e-48f3-9116-8bc34551875d tempest-CreateVolumesFromImageTest-1616363142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:26 devstack sudo[88171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:17:26 devstack sudo[88171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:26 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7749a5fb-1066-4dc4-bb89-ded3147a83ad tempest-CreateVolumesFromImageTest-1616363142 None] Acquiring lock "cinder-7d596878-b6b9-467e-88b9-3e30d86f7187-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:17:26 devstack sudo[88150]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b584cc7b-28ab-4857-8684-bcbb13f6e5b9 tempest-SnapshotMetadataTestJSON-199548848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-08938e0c-b4d2-4557-8179-a95a70fbce0d.1dc63892-f9ea-4593-841e-690a71014c30" returned: 0 in 0.808s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:26 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7749a5fb-1066-4dc4-bb89-ded3147a83ad tempest-CreateVolumesFromImageTest-1616363142 None] Lock "cinder-7d596878-b6b9-467e-88b9-3e30d86f7187-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:17:26 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7749a5fb-1066-4dc4-bb89-ded3147a83ad tempest-CreateVolumesFromImageTest-1616363142 None] Acquiring lock "cinder-quobyte-7d596878-b6b9-467e-88b9-3e30d86f7187" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:17:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b584cc7b-28ab-4857-8684-bcbb13f6e5b9 tempest-SnapshotMetadataTestJSON-199548848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-08938e0c-b4d2-4557-8179-a95a70fbce0d.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:26 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7749a5fb-1066-4dc4-bb89-ded3147a83ad tempest-CreateVolumesFromImageTest-1616363142 None] Lock "cinder-quobyte-7d596878-b6b9-467e-88b9-3e30d86f7187" acquired by "delete_volume" :: waited 0.041s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:17:26 devstack sudo[88179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-08938e0c-b4d2-4557-8179-a95a70fbce0d.info Apr 28 19:17:26 devstack sudo[88179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:26 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[823491d3-5ce4-4275-8bf7-c53c048e4654]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:17:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7749a5fb-1066-4dc4-bb89-ded3147a83ad tempest-CreateVolumesFromImageTest-1616363142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7d596878-b6b9-467e-88b9-3e30d86f7187 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:27 devstack sudo[88181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7d596878-b6b9-467e-88b9-3e30d86f7187 Apr 28 19:17:27 devstack sudo[88181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:27 devstack sudo[88171]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-65049c76-e43e-48f3-9116-8bc34551875d tempest-CreateVolumesFromImageTest-1616363142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.701s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:27 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-65049c76-e43e-48f3-9116-8bc34551875d tempest-CreateVolumesFromImageTest-1616363142 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:17:27 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-65049c76-e43e-48f3-9116-8bc34551875d tempest-CreateVolumesFromImageTest-1616363142 None] Deleted volume successfully. Apr 28 19:17:27 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-65049c76-e43e-48f3-9116-8bc34551875d tempest-CreateVolumesFromImageTest-1616363142 None] Lock "cinder-6eebd926-0d33-44b7-b6eb-7da14299e30d-delete_volume" released by "delete_volume" :: held 3.048s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:17:27 devstack sudo[88179]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b584cc7b-28ab-4857-8684-bcbb13f6e5b9 tempest-SnapshotMetadataTestJSON-199548848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-08938e0c-b4d2-4557-8179-a95a70fbce0d.info" returned: 0 in 0.685s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:27 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-b584cc7b-28ab-4857-8684-bcbb13f6e5b9 tempest-SnapshotMetadataTestJSON-199548848 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-08938e0c-b4d2-4557-8179-a95a70fbce0d.info is being set with open permissions: ugo+rw Apr 28 19:17:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b584cc7b-28ab-4857-8684-bcbb13f6e5b9 tempest-SnapshotMetadataTestJSON-199548848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-08938e0c-b4d2-4557-8179-a95a70fbce0d.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:27 devstack sudo[88185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-08938e0c-b4d2-4557-8179-a95a70fbce0d.info Apr 28 19:17:27 devstack sudo[88185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:27 devstack sudo[88181]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7749a5fb-1066-4dc4-bb89-ded3147a83ad tempest-CreateVolumesFromImageTest-1616363142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7d596878-b6b9-467e-88b9-3e30d86f7187" returned: 0 in 0.769s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7749a5fb-1066-4dc4-bb89-ded3147a83ad tempest-CreateVolumesFromImageTest-1616363142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7d596878-b6b9-467e-88b9-3e30d86f7187 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:27 devstack sudo[88190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7d596878-b6b9-467e-88b9-3e30d86f7187 Apr 28 19:17:27 devstack sudo[88190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:28 devstack sudo[88185]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b584cc7b-28ab-4857-8684-bcbb13f6e5b9 tempest-SnapshotMetadataTestJSON-199548848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-08938e0c-b4d2-4557-8179-a95a70fbce0d.info" returned: 0 in 0.634s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b584cc7b-28ab-4857-8684-bcbb13f6e5b9 tempest-SnapshotMetadataTestJSON-199548848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.186s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:17:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-25f4bcc9-f061-4f72-b669-b47fc429633a tempest-SnapshotsActionsTest-904821522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.726s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:17:28 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:SELECT=134,cinder:UPDATE=169,cinder:INSERT=41,cinder:DELETE=17 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 19:17:28 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:SELECT=144,cinder:INSERT=47,cinder:UPDATE=159,cinder:DELETE=10 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 19:17:28 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-25f4bcc9-f061-4f72-b669-b47fc429633a tempest-SnapshotsActionsTest-904821522 None] Creating offline snapshot 99be7d60-8750-4b98-8ccb-015bf95427de of volume da601bc0-f975-4bd3-8926-4b6098299f9d {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 19:17:28 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ff46d6-3e11-4ad0-9d64-adac8a4e520b]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:17:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-25f4bcc9-f061-4f72-b669-b47fc429633a tempest-SnapshotsActionsTest-904821522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:28 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-b584cc7b-28ab-4857-8684-bcbb13f6e5b9 tempest-SnapshotMetadataTestJSON-199548848 None] Create snapshot completed successfully Apr 28 19:17:28 devstack sudo[88190]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7749a5fb-1066-4dc4-bb89-ded3147a83ad tempest-CreateVolumesFromImageTest-1616363142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7d596878-b6b9-467e-88b9-3e30d86f7187" returned: 0 in 0.636s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:28 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7749a5fb-1066-4dc4-bb89-ded3147a83ad tempest-CreateVolumesFromImageTest-1616363142 None] Lock "cinder-quobyte-7d596878-b6b9-467e-88b9-3e30d86f7187" released by "delete_volume" :: held 1.464s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:17:28 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-7749a5fb-1066-4dc4-bb89-ded3147a83ad tempest-CreateVolumesFromImageTest-1616363142 None] Created reservations ['6884ee52-c6c7-4f89-a272-58778cfbdff5', 'add5a66f-aae3-4fd0-9d48-02cc38113269', 'e68957a2-b330-4961-9616-6179d66d89b9', '32c44f10-a7be-490a-839e-47c6e1f0b483'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:17:28 devstack sudo[88195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe Apr 28 19:17:28 devstack sudo[88195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7749a5fb-1066-4dc4-bb89-ded3147a83ad tempest-CreateVolumesFromImageTest-1616363142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:17:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7749a5fb-1066-4dc4-bb89-ded3147a83ad tempest-CreateVolumesFromImageTest-1616363142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:17:28 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7749a5fb-1066-4dc4-bb89-ded3147a83ad tempest-CreateVolumesFromImageTest-1616363142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:17:28 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7749a5fb-1066-4dc4-bb89-ded3147a83ad tempest-CreateVolumesFromImageTest-1616363142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:17:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7749a5fb-1066-4dc4-bb89-ded3147a83ad tempest-CreateVolumesFromImageTest-1616363142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:17:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7749a5fb-1066-4dc4-bb89-ded3147a83ad tempest-CreateVolumesFromImageTest-1616363142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:28 devstack sudo[88197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:17:28 devstack sudo[88197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:29 devstack sudo[88195]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-25f4bcc9-f061-4f72-b669-b47fc429633a tempest-SnapshotsActionsTest-904821522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe" returned: 0 in 0.820s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:29 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-25f4bcc9-f061-4f72-b669-b47fc429633a tempest-SnapshotsActionsTest-904821522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da601bc0-f975-4bd3-8926-4b6098299f9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:17:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-25f4bcc9-f061-4f72-b669-b47fc429633a tempest-SnapshotsActionsTest-904821522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.99be7d60-8750-4b98-8ccb-015bf95427de 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:29 devstack sudo[88197]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7749a5fb-1066-4dc4-bb89-ded3147a83ad tempest-CreateVolumesFromImageTest-1616363142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.623s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:29 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-7749a5fb-1066-4dc4-bb89-ded3147a83ad tempest-CreateVolumesFromImageTest-1616363142 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:17:29 devstack sudo[88207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.99be7d60-8750-4b98-8ccb-015bf95427de 1G Apr 28 19:17:29 devstack sudo[88207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:29 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-7749a5fb-1066-4dc4-bb89-ded3147a83ad tempest-CreateVolumesFromImageTest-1616363142 None] Deleted volume successfully. Apr 28 19:17:29 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7749a5fb-1066-4dc4-bb89-ded3147a83ad tempest-CreateVolumesFromImageTest-1616363142 None] Lock "cinder-7d596878-b6b9-467e-88b9-3e30d86f7187-delete_volume" released by "delete_volume" :: held 2.398s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:17:30 devstack sudo[88207]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-25f4bcc9-f061-4f72-b669-b47fc429633a tempest-SnapshotsActionsTest-904821522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.99be7d60-8750-4b98-8ccb-015bf95427de 1G" returned: 0 in 1.093s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-25f4bcc9-f061-4f72-b669-b47fc429633a tempest-SnapshotsActionsTest-904821522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.99be7d60-8750-4b98-8ccb-015bf95427de {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:30 devstack sudo[88216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.99be7d60-8750-4b98-8ccb-015bf95427de Apr 28 19:17:30 devstack sudo[88216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:30 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-938deddd-edeb-4dff-b848-82ad6cd7286b tempest-SnapshotMetadataTestJSON-199548848 None] Acquiring lock "cinder-1dc63892-f9ea-4593-841e-690a71014c30-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:17:30 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-938deddd-edeb-4dff-b848-82ad6cd7286b tempest-SnapshotMetadataTestJSON-199548848 None] Lock "cinder-1dc63892-f9ea-4593-841e-690a71014c30-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:17:30 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-938deddd-edeb-4dff-b848-82ad6cd7286b tempest-SnapshotMetadataTestJSON-199548848 None] Acquiring lock "cinder-quobyte-08938e0c-b4d2-4557-8179-a95a70fbce0d" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:17:30 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-938deddd-edeb-4dff-b848-82ad6cd7286b tempest-SnapshotMetadataTestJSON-199548848 None] Lock "cinder-quobyte-08938e0c-b4d2-4557-8179-a95a70fbce0d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:17:30 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-938deddd-edeb-4dff-b848-82ad6cd7286b tempest-SnapshotMetadataTestJSON-199548848 None] Acquiring lock "cinder-quobyte-1dc63892-f9ea-4593-841e-690a71014c30" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:17:30 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-938deddd-edeb-4dff-b848-82ad6cd7286b tempest-SnapshotMetadataTestJSON-199548848 None] Lock "cinder-quobyte-1dc63892-f9ea-4593-841e-690a71014c30" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:17:30 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-938deddd-edeb-4dff-b848-82ad6cd7286b tempest-SnapshotMetadataTestJSON-199548848 None] Deleting offline snapshot 1dc63892-f9ea-4593-841e-690a71014c30 of volume 08938e0c-b4d2-4557-8179-a95a70fbce0d {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 19:17:30 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-938deddd-edeb-4dff-b848-82ad6cd7286b tempest-SnapshotMetadataTestJSON-199548848 None] snapshot_file for this snap is: volume-08938e0c-b4d2-4557-8179-a95a70fbce0d.1dc63892-f9ea-4593-841e-690a71014c30 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 19:17:30 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda3fc60-021a-4e50-bd70-41a2d4519168]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:17:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-938deddd-edeb-4dff-b848-82ad6cd7286b tempest-SnapshotMetadataTestJSON-199548848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-08938e0c-b4d2-4557-8179-a95a70fbce0d.1dc63892-f9ea-4593-841e-690a71014c30 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:30 devstack sudo[88219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-08938e0c-b4d2-4557-8179-a95a70fbce0d.1dc63892-f9ea-4593-841e-690a71014c30 Apr 28 19:17:30 devstack sudo[88219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:30 devstack sudo[88216]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-25f4bcc9-f061-4f72-b669-b47fc429633a tempest-SnapshotsActionsTest-904821522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.99be7d60-8750-4b98-8ccb-015bf95427de" returned: 0 in 0.793s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:31 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-25f4bcc9-f061-4f72-b669-b47fc429633a tempest-SnapshotsActionsTest-904821522 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.99be7d60-8750-4b98-8ccb-015bf95427de is being set with open permissions: ugo+rw Apr 28 19:17:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-25f4bcc9-f061-4f72-b669-b47fc429633a tempest-SnapshotsActionsTest-904821522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.99be7d60-8750-4b98-8ccb-015bf95427de {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:31 devstack sudo[88224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.99be7d60-8750-4b98-8ccb-015bf95427de Apr 28 19:17:31 devstack sudo[88224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:31 devstack sudo[88219]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-938deddd-edeb-4dff-b848-82ad6cd7286b tempest-SnapshotMetadataTestJSON-199548848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-08938e0c-b4d2-4557-8179-a95a70fbce0d.1dc63892-f9ea-4593-841e-690a71014c30" returned: 0 in 1.277s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:31 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-938deddd-edeb-4dff-b848-82ad6cd7286b tempest-SnapshotMetadataTestJSON-199548848 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08938e0c-b4d2-4557-8179-a95a70fbce0d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:17:31 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[80427524-e56e-4263-9762-9cb72003cc90]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:17:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-938deddd-edeb-4dff-b848-82ad6cd7286b tempest-SnapshotMetadataTestJSON-199548848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-08938e0c-b4d2-4557-8179-a95a70fbce0d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:32 devstack sudo[88224]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-25f4bcc9-f061-4f72-b669-b47fc429633a tempest-SnapshotsActionsTest-904821522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.99be7d60-8750-4b98-8ccb-015bf95427de" returned: 0 in 1.064s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-25f4bcc9-f061-4f72-b669-b47fc429633a tempest-SnapshotsActionsTest-904821522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.929s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:17:32 devstack sudo[88292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-08938e0c-b4d2-4557-8179-a95a70fbce0d Apr 28 19:17:32 devstack sudo[88292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:32 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-25f4bcc9-f061-4f72-b669-b47fc429633a tempest-SnapshotsActionsTest-904821522 None] Create snapshot completed successfully Apr 28 19:17:33 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-87edc545-2d5f-4244-98dd-252db263f0d5 tempest-SnapshotsActionsTest-189624283 None] Acquiring lock "cinder-99be7d60-8750-4b98-8ccb-015bf95427de-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:17:33 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-87edc545-2d5f-4244-98dd-252db263f0d5 tempest-SnapshotsActionsTest-189624283 None] Lock "cinder-99be7d60-8750-4b98-8ccb-015bf95427de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.073s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:17:33 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-87edc545-2d5f-4244-98dd-252db263f0d5 tempest-SnapshotsActionsTest-189624283 None] Acquiring lock "cinder-quobyte-da601bc0-f975-4bd3-8926-4b6098299f9d" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:17:33 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-87edc545-2d5f-4244-98dd-252db263f0d5 tempest-SnapshotsActionsTest-189624283 None] Lock "cinder-quobyte-da601bc0-f975-4bd3-8926-4b6098299f9d" acquired by "delete_snapshot" :: waited 0.059s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:17:33 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-87edc545-2d5f-4244-98dd-252db263f0d5 tempest-SnapshotsActionsTest-189624283 None] Acquiring lock "cinder-quobyte-99be7d60-8750-4b98-8ccb-015bf95427de" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:17:33 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-87edc545-2d5f-4244-98dd-252db263f0d5 tempest-SnapshotsActionsTest-189624283 None] Lock "cinder-quobyte-99be7d60-8750-4b98-8ccb-015bf95427de" acquired by "_delete_snapshot" :: waited 0.075s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:17:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-87edc545-2d5f-4244-98dd-252db263f0d5 tempest-SnapshotsActionsTest-189624283 None] Deleting offline snapshot 99be7d60-8750-4b98-8ccb-015bf95427de of volume da601bc0-f975-4bd3-8926-4b6098299f9d {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 19:17:33 devstack sudo[88292]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-87edc545-2d5f-4244-98dd-252db263f0d5 tempest-SnapshotsActionsTest-189624283 None] snapshot_file for this snap is: volume-da601bc0-f975-4bd3-8926-4b6098299f9d.99be7d60-8750-4b98-8ccb-015bf95427de {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 19:17:33 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc971894-f8b4-4292-8222-7650109b54d6 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:17:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-bc971894-f8b4-4292-8222-7650109b54d6 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Flow 'volume_create_manager' (1c35126e-cff8-40f0-8fba-b9920e01d03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:17:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-bc971894-f8b4-4292-8222-7650109b54d6 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c8c9bd9-cd6e-4ebf-b6e0-7aa123ccdc6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:33 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9f9add-6b61-4436-855c-04d24e87449f]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:17:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-87edc545-2d5f-4244-98dd-252db263f0d5 tempest-SnapshotsActionsTest-189624283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.99be7d60-8750-4b98-8ccb-015bf95427de {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-938deddd-edeb-4dff-b848-82ad6cd7286b tempest-SnapshotMetadataTestJSON-199548848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-08938e0c-b4d2-4557-8179-a95a70fbce0d" returned: 0 in 1.437s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-938deddd-edeb-4dff-b848-82ad6cd7286b tempest-SnapshotMetadataTestJSON-199548848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-08938e0c-b4d2-4557-8179-a95a70fbce0d.1dc63892-f9ea-4593-841e-690a71014c30 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-bc971894-f8b4-4292-8222-7650109b54d6 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c8c9bd9-cd6e-4ebf-b6e0-7aa123ccdc6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1834615201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b7b35bd-5aeb-463a-95a3-20d5480a68ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea247c1004da4ad58b762b011dbad901',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:17:33Z,use_quota=True,user_id='d1621fc748594438ae6400abe59c5d03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-bc971894-f8b4-4292-8222-7650109b54d6 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0396a30a-8940-43bd-aa6b-0f0dc4f8acff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-bc971894-f8b4-4292-8222-7650109b54d6 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0396a30a-8940-43bd-aa6b-0f0dc4f8acff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-bc971894-f8b4-4292-8222-7650109b54d6 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3415010f-c158-4894-b82a-59a04b210868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-bc971894-f8b4-4292-8222-7650109b54d6 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3415010f-c158-4894-b82a-59a04b210868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b7b35bd-5aeb-463a-95a3-20d5480a68ae', 'volume_name': 'volume-9b7b35bd-5aeb-463a-95a3-20d5480a68ae', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-bc971894-f8b4-4292-8222-7650109b54d6 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54ce2792-d4d8-480d-8f01-c3c5de65539d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:33 devstack sudo[88336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-08938e0c-b4d2-4557-8179-a95a70fbce0d.1dc63892-f9ea-4593-841e-690a71014c30 Apr 28 19:17:33 devstack sudo[88336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-bc971894-f8b4-4292-8222-7650109b54d6 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54ce2792-d4d8-480d-8f01-c3c5de65539d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-bc971894-f8b4-4292-8222-7650109b54d6 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19332f15-195d-495d-ae53-2dc72f9601d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:33 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-bc971894-f8b4-4292-8222-7650109b54d6 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Volume 9b7b35bd-5aeb-463a-95a3-20d5480a68ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b7b35bd-5aeb-463a-95a3-20d5480a68ae', 'volume_size': 1} Apr 28 19:17:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-bc971894-f8b4-4292-8222-7650109b54d6 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:17:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-bc971894-f8b4-4292-8222-7650109b54d6 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:17:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-bc971894-f8b4-4292-8222-7650109b54d6 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1834615201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b7b35bd-5aeb-463a-95a3-20d5480a68ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea247c1004da4ad58b762b011dbad901',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:17:33Z,use_quota=True,user_id='d1621fc748594438ae6400abe59c5d03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:17:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-bc971894-f8b4-4292-8222-7650109b54d6 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Creating volume 9b7b35bd-5aeb-463a-95a3-20d5480a68ae {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:17:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-bc971894-f8b4-4292-8222-7650109b54d6 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:17:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-bc971894-f8b4-4292-8222-7650109b54d6 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:17:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-bc971894-f8b4-4292-8222-7650109b54d6 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:17:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-bc971894-f8b4-4292-8222-7650109b54d6 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:17:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-bc971894-f8b4-4292-8222-7650109b54d6 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:17:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-bc971894-f8b4-4292-8222-7650109b54d6 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:17:33 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-bc971894-f8b4-4292-8222-7650109b54d6 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:17:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bc971894-f8b4-4292-8222-7650109b54d6 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9b7b35bd-5aeb-463a-95a3-20d5480a68ae 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:33 devstack sudo[88335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.99be7d60-8750-4b98-8ccb-015bf95427de Apr 28 19:17:33 devstack sudo[88335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:33 devstack sudo[88338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9b7b35bd-5aeb-463a-95a3-20d5480a68ae 1073741824 Apr 28 19:17:33 devstack sudo[88338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:34 devstack sudo[88335]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-87edc545-2d5f-4244-98dd-252db263f0d5 tempest-SnapshotsActionsTest-189624283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.99be7d60-8750-4b98-8ccb-015bf95427de" returned: 0 in 0.959s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:34 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-87edc545-2d5f-4244-98dd-252db263f0d5 tempest-SnapshotsActionsTest-189624283 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da601bc0-f975-4bd3-8926-4b6098299f9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:17:34 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4494eb68-a3ce-4e3d-9017-2b8aa0f2a340]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:17:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-87edc545-2d5f-4244-98dd-252db263f0d5 tempest-SnapshotsActionsTest-189624283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:34 devstack sudo[88336]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-938deddd-edeb-4dff-b848-82ad6cd7286b tempest-SnapshotMetadataTestJSON-199548848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-08938e0c-b4d2-4557-8179-a95a70fbce0d.1dc63892-f9ea-4593-841e-690a71014c30" returned: 0 in 0.967s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-938deddd-edeb-4dff-b848-82ad6cd7286b tempest-SnapshotMetadataTestJSON-199548848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-08938e0c-b4d2-4557-8179-a95a70fbce0d.1dc63892-f9ea-4593-841e-690a71014c30 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:34 devstack sudo[88354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-08938e0c-b4d2-4557-8179-a95a70fbce0d.1dc63892-f9ea-4593-841e-690a71014c30 Apr 28 19:17:34 devstack sudo[88354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:34 devstack sudo[88353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe Apr 28 19:17:34 devstack sudo[88353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:34 devstack sudo[88338]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bc971894-f8b4-4292-8222-7650109b54d6 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9b7b35bd-5aeb-463a-95a3-20d5480a68ae 1073741824" returned: 0 in 1.142s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bc971894-f8b4-4292-8222-7650109b54d6 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9b7b35bd-5aeb-463a-95a3-20d5480a68ae {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:34 devstack sudo[88357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9b7b35bd-5aeb-463a-95a3-20d5480a68ae Apr 28 19:17:34 devstack sudo[88357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:35 devstack sudo[88354]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-938deddd-edeb-4dff-b848-82ad6cd7286b tempest-SnapshotMetadataTestJSON-199548848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-08938e0c-b4d2-4557-8179-a95a70fbce0d.1dc63892-f9ea-4593-841e-690a71014c30" returned: 0 in 1.027s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:35 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-938deddd-edeb-4dff-b848-82ad6cd7286b tempest-SnapshotMetadataTestJSON-199548848 None] Lock "cinder-quobyte-1dc63892-f9ea-4593-841e-690a71014c30" released by "_delete_snapshot" :: held 4.910s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:17:35 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-938deddd-edeb-4dff-b848-82ad6cd7286b tempest-SnapshotMetadataTestJSON-199548848 None] Lock "cinder-quobyte-08938e0c-b4d2-4557-8179-a95a70fbce0d" released by "delete_snapshot" :: held 4.945s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:17:35 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-938deddd-edeb-4dff-b848-82ad6cd7286b tempest-SnapshotMetadataTestJSON-199548848 None] Created reservations ['0f9721e4-fd34-416e-9058-ee04326301fe', '1c32b728-a171-44d0-9cc5-5f7c4a39b3b4', '75dbb978-24e5-4171-82ef-5f0512430c2c', '765bc2e5-082a-41bb-8546-a349bb60be53'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:17:35 devstack sudo[88353]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-87edc545-2d5f-4244-98dd-252db263f0d5 tempest-SnapshotsActionsTest-189624283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe" returned: 0 in 1.262s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:35 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-87edc545-2d5f-4244-98dd-252db263f0d5 tempest-SnapshotsActionsTest-189624283 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da601bc0-f975-4bd3-8926-4b6098299f9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:17:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-87edc545-2d5f-4244-98dd-252db263f0d5 tempest-SnapshotsActionsTest-189624283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.99be7d60-8750-4b98-8ccb-015bf95427de {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:35 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-938deddd-edeb-4dff-b848-82ad6cd7286b tempest-SnapshotMetadataTestJSON-199548848 None] Delete snapshot completed successfully. Apr 28 19:17:35 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-938deddd-edeb-4dff-b848-82ad6cd7286b tempest-SnapshotMetadataTestJSON-199548848 None] Lock "cinder-1dc63892-f9ea-4593-841e-690a71014c30-delete_snapshot" released by "delete_snapshot" :: held 5.171s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:17:35 devstack sudo[88365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.99be7d60-8750-4b98-8ccb-015bf95427de Apr 28 19:17:35 devstack sudo[88365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:35 devstack sudo[88357]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bc971894-f8b4-4292-8222-7650109b54d6 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9b7b35bd-5aeb-463a-95a3-20d5480a68ae" returned: 0 in 0.992s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:35 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-bc971894-f8b4-4292-8222-7650109b54d6 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] <== create_volume: return (2213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:17:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-bc971894-f8b4-4292-8222-7650109b54d6 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.217s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:17:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-bc971894-f8b4-4292-8222-7650109b54d6 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19332f15-195d-495d-ae53-2dc72f9601d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b7b35bd-5aeb-463a-95a3-20d5480a68ae', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-bc971894-f8b4-4292-8222-7650109b54d6 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3576835-bbe6-4350-b77e-fa3920eb4d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:35 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-bc971894-f8b4-4292-8222-7650109b54d6 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Volume volume-9b7b35bd-5aeb-463a-95a3-20d5480a68ae (9b7b35bd-5aeb-463a-95a3-20d5480a68ae): created successfully Apr 28 19:17:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-bc971894-f8b4-4292-8222-7650109b54d6 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3576835-bbe6-4350-b77e-fa3920eb4d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-bc971894-f8b4-4292-8222-7650109b54d6 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Flow 'volume_create_manager' (1c35126e-cff8-40f0-8fba-b9920e01d03d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:17:35 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-bc971894-f8b4-4292-8222-7650109b54d6 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Created volume successfully. Apr 28 19:17:35 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-fbb8bb16-189e-4170-a87d-99b3fb99d118 tempest-SnapshotMetadataTestJSON-199548848 None] Acquiring lock "cinder-08938e0c-b4d2-4557-8179-a95a70fbce0d-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:17:36 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-fbb8bb16-189e-4170-a87d-99b3fb99d118 tempest-SnapshotMetadataTestJSON-199548848 None] Lock "cinder-08938e0c-b4d2-4557-8179-a95a70fbce0d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:17:36 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-fbb8bb16-189e-4170-a87d-99b3fb99d118 tempest-SnapshotMetadataTestJSON-199548848 None] Acquiring lock "cinder-quobyte-08938e0c-b4d2-4557-8179-a95a70fbce0d" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:17:36 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-fbb8bb16-189e-4170-a87d-99b3fb99d118 tempest-SnapshotMetadataTestJSON-199548848 None] Lock "cinder-quobyte-08938e0c-b4d2-4557-8179-a95a70fbce0d" acquired by "delete_volume" :: waited 0.018s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:17:36 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4c8751-ea1a-4560-94a2-58b27c3460ab]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:17:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fbb8bb16-189e-4170-a87d-99b3fb99d118 tempest-SnapshotMetadataTestJSON-199548848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-08938e0c-b4d2-4557-8179-a95a70fbce0d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:36 devstack sudo[88367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-08938e0c-b4d2-4557-8179-a95a70fbce0d Apr 28 19:17:36 devstack sudo[88367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:36 devstack sudo[88365]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-87edc545-2d5f-4244-98dd-252db263f0d5 tempest-SnapshotsActionsTest-189624283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.99be7d60-8750-4b98-8ccb-015bf95427de" returned: 0 in 1.006s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-87edc545-2d5f-4244-98dd-252db263f0d5 tempest-SnapshotsActionsTest-189624283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.99be7d60-8750-4b98-8ccb-015bf95427de {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:36 devstack sudo[88373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.99be7d60-8750-4b98-8ccb-015bf95427de Apr 28 19:17:36 devstack sudo[88373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:37 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b1fbf4f-187e-4fd6-a175-1d539002fbbd tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:17:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1b1fbf4f-187e-4fd6-a175-1d539002fbbd tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Flow 'volume_create_manager' (b9a108c5-8132-4f10-85b9-4276bf8db3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:17:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1b1fbf4f-187e-4fd6-a175-1d539002fbbd tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c002fc07-0eac-4c4e-abb4-cf2b40b17b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1b1fbf4f-187e-4fd6-a175-1d539002fbbd tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c002fc07-0eac-4c4e-abb4-cf2b40b17b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1724276237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c9ca9f3-3624-4528-9805-619e04833871,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea247c1004da4ad58b762b011dbad901',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:17:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:17:37Z,use_quota=True,user_id='d1621fc748594438ae6400abe59c5d03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1b1fbf4f-187e-4fd6-a175-1d539002fbbd tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (762af4e6-1fa9-4588-b9ae-3330908cc8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1b1fbf4f-187e-4fd6-a175-1d539002fbbd tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (762af4e6-1fa9-4588-b9ae-3330908cc8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1b1fbf4f-187e-4fd6-a175-1d539002fbbd tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (729258eb-24d9-4060-8cb4-1e0547ac8abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1b1fbf4f-187e-4fd6-a175-1d539002fbbd tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (729258eb-24d9-4060-8cb4-1e0547ac8abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c9ca9f3-3624-4528-9805-619e04833871', 'volume_name': 'volume-7c9ca9f3-3624-4528-9805-619e04833871', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1b1fbf4f-187e-4fd6-a175-1d539002fbbd tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9736e82-e112-42c1-88a3-e454b1b17c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1b1fbf4f-187e-4fd6-a175-1d539002fbbd tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9736e82-e112-42c1-88a3-e454b1b17c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1b1fbf4f-187e-4fd6-a175-1d539002fbbd tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9755003-a331-472f-b9e6-a41a56292722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:37 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-1b1fbf4f-187e-4fd6-a175-1d539002fbbd tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Volume 7c9ca9f3-3624-4528-9805-619e04833871: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c9ca9f3-3624-4528-9805-619e04833871', 'volume_size': 1} Apr 28 19:17:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1b1fbf4f-187e-4fd6-a175-1d539002fbbd tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:17:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1b1fbf4f-187e-4fd6-a175-1d539002fbbd tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:17:37 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1b1fbf4f-187e-4fd6-a175-1d539002fbbd tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1724276237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c9ca9f3-3624-4528-9805-619e04833871,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea247c1004da4ad58b762b011dbad901',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:17:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:17:37Z,use_quota=True,user_id='d1621fc748594438ae6400abe59c5d03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:17:37 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-1b1fbf4f-187e-4fd6-a175-1d539002fbbd tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Creating volume 7c9ca9f3-3624-4528-9805-619e04833871 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:17:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1b1fbf4f-187e-4fd6-a175-1d539002fbbd tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:17:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1b1fbf4f-187e-4fd6-a175-1d539002fbbd tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:17:37 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1b1fbf4f-187e-4fd6-a175-1d539002fbbd tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:17:37 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1b1fbf4f-187e-4fd6-a175-1d539002fbbd tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:17:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1b1fbf4f-187e-4fd6-a175-1d539002fbbd tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:17:37 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1b1fbf4f-187e-4fd6-a175-1d539002fbbd tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:17:37 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-1b1fbf4f-187e-4fd6-a175-1d539002fbbd tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:17:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1b1fbf4f-187e-4fd6-a175-1d539002fbbd tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7c9ca9f3-3624-4528-9805-619e04833871 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:37 devstack sudo[88367]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fbb8bb16-189e-4170-a87d-99b3fb99d118 tempest-SnapshotMetadataTestJSON-199548848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-08938e0c-b4d2-4557-8179-a95a70fbce0d" returned: 0 in 1.241s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fbb8bb16-189e-4170-a87d-99b3fb99d118 tempest-SnapshotMetadataTestJSON-199548848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-08938e0c-b4d2-4557-8179-a95a70fbce0d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:37 devstack sudo[88378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7c9ca9f3-3624-4528-9805-619e04833871 1073741824 Apr 28 19:17:37 devstack sudo[88378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:37 devstack sudo[88380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-08938e0c-b4d2-4557-8179-a95a70fbce0d Apr 28 19:17:37 devstack sudo[88380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:37 devstack sudo[88373]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-87edc545-2d5f-4244-98dd-252db263f0d5 tempest-SnapshotsActionsTest-189624283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.99be7d60-8750-4b98-8ccb-015bf95427de" returned: 0 in 1.080s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:37 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-87edc545-2d5f-4244-98dd-252db263f0d5 tempest-SnapshotsActionsTest-189624283 None] Lock "cinder-quobyte-99be7d60-8750-4b98-8ccb-015bf95427de" released by "_delete_snapshot" :: held 4.599s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:17:37 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-87edc545-2d5f-4244-98dd-252db263f0d5 tempest-SnapshotsActionsTest-189624283 None] Lock "cinder-quobyte-da601bc0-f975-4bd3-8926-4b6098299f9d" released by "delete_snapshot" :: held 4.699s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:17:37 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ffa6595-9033-4ab8-bf7f-48df6aa345ee tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:17:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0ffa6595-9033-4ab8-bf7f-48df6aa345ee tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Flow 'volume_create_manager' (ec00cd0a-70f0-4f6e-83b5-7d46d1f91ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:17:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0ffa6595-9033-4ab8-bf7f-48df6aa345ee tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36eea491-bd61-4b2c-b2cc-d1348abc8f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0ffa6595-9033-4ab8-bf7f-48df6aa345ee tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36eea491-bd61-4b2c-b2cc-d1348abc8f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1649197117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55ca4688-fd7b-4ef3-a3b3-d90fbd825171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea247c1004da4ad58b762b011dbad901',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:17:38Z,use_quota=True,user_id='d1621fc748594438ae6400abe59c5d03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0ffa6595-9033-4ab8-bf7f-48df6aa345ee tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d5fb895-383f-4fc8-9356-f496f09d361a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0ffa6595-9033-4ab8-bf7f-48df6aa345ee tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d5fb895-383f-4fc8-9356-f496f09d361a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0ffa6595-9033-4ab8-bf7f-48df6aa345ee tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (157059fb-0792-4fa3-8fe0-096d4f32a745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0ffa6595-9033-4ab8-bf7f-48df6aa345ee tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (157059fb-0792-4fa3-8fe0-096d4f32a745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55ca4688-fd7b-4ef3-a3b3-d90fbd825171', 'volume_name': 'volume-55ca4688-fd7b-4ef3-a3b3-d90fbd825171', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0ffa6595-9033-4ab8-bf7f-48df6aa345ee tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b015b163-78fc-4e31-858e-f59d6a83368f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0ffa6595-9033-4ab8-bf7f-48df6aa345ee tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b015b163-78fc-4e31-858e-f59d6a83368f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0ffa6595-9033-4ab8-bf7f-48df6aa345ee tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b5722c2-d6b0-488e-928c-5d16ca6d6203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:38 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-0ffa6595-9033-4ab8-bf7f-48df6aa345ee tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Volume 55ca4688-fd7b-4ef3-a3b3-d90fbd825171: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55ca4688-fd7b-4ef3-a3b3-d90fbd825171', 'volume_size': 1} Apr 28 19:17:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0ffa6595-9033-4ab8-bf7f-48df6aa345ee tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:17:38 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-87edc545-2d5f-4244-98dd-252db263f0d5 tempest-SnapshotsActionsTest-189624283 None] Created reservations ['a2df9f62-8df0-4ff5-9669-41abe4e00688', '1cc6afd3-d9b0-4f08-87f5-3b589b13a7b2', '40f2f8ad-e90b-4762-a9e4-c30bb69549d0', '26209689-0ba8-428b-878a-b9673841ca1c'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:17:38 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-87edc545-2d5f-4244-98dd-252db263f0d5 tempest-SnapshotsActionsTest-189624283 None] Delete snapshot completed successfully. Apr 28 19:17:38 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-87edc545-2d5f-4244-98dd-252db263f0d5 tempest-SnapshotsActionsTest-189624283 None] Lock "cinder-99be7d60-8750-4b98-8ccb-015bf95427de-delete_snapshot" released by "delete_snapshot" :: held 5.307s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:17:38 devstack sudo[88380]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fbb8bb16-189e-4170-a87d-99b3fb99d118 tempest-SnapshotMetadataTestJSON-199548848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-08938e0c-b4d2-4557-8179-a95a70fbce0d" returned: 0 in 1.062s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:38 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-fbb8bb16-189e-4170-a87d-99b3fb99d118 tempest-SnapshotMetadataTestJSON-199548848 None] Lock "cinder-quobyte-08938e0c-b4d2-4557-8179-a95a70fbce0d" released by "delete_volume" :: held 2.410s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:17:38 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-fbb8bb16-189e-4170-a87d-99b3fb99d118 tempest-SnapshotMetadataTestJSON-199548848 None] Created reservations ['3bab3e2a-16f9-424e-9f01-9d4bc42b4419', '04246085-efa1-4862-bae6-3cc8b1ec7e30', 'be7be731-37f6-4956-91ad-7311ff1d5aea', '360c2498-c178-4c6a-af5b-5ed4aba05f27'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:17:38 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-f81e6be9-d8a4-4a1e-8802-267411c3cf0f tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:17:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f81e6be9-d8a4-4a1e-8802-267411c3cf0f tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Flow 'volume_create_manager' (807fddcd-4033-49e6-a072-3524673b9e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:17:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f81e6be9-d8a4-4a1e-8802-267411c3cf0f tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c1d1e1e-a928-4f14-bf1a-3176654baec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f81e6be9-d8a4-4a1e-8802-267411c3cf0f tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c1d1e1e-a928-4f14-bf1a-3176654baec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-237828661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37dfd053-a43a-4751-9b58-9fd0d11d3f95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea247c1004da4ad58b762b011dbad901',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:17:39Z,use_quota=True,user_id='d1621fc748594438ae6400abe59c5d03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f81e6be9-d8a4-4a1e-8802-267411c3cf0f tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd24988d-185c-4c5b-ad0f-b9fb6a195502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f81e6be9-d8a4-4a1e-8802-267411c3cf0f tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd24988d-185c-4c5b-ad0f-b9fb6a195502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f81e6be9-d8a4-4a1e-8802-267411c3cf0f tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46409a83-e03e-4d75-9b07-95ed67711ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f81e6be9-d8a4-4a1e-8802-267411c3cf0f tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46409a83-e03e-4d75-9b07-95ed67711ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37dfd053-a43a-4751-9b58-9fd0d11d3f95', 'volume_name': 'volume-37dfd053-a43a-4751-9b58-9fd0d11d3f95', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f81e6be9-d8a4-4a1e-8802-267411c3cf0f tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f8f539-82c2-4c71-affd-56aaef2cb88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f81e6be9-d8a4-4a1e-8802-267411c3cf0f tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f8f539-82c2-4c71-affd-56aaef2cb88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f81e6be9-d8a4-4a1e-8802-267411c3cf0f tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d8b1ff7-74cf-4ef3-b545-8e787e64bad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:38 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-f81e6be9-d8a4-4a1e-8802-267411c3cf0f tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Volume 37dfd053-a43a-4751-9b58-9fd0d11d3f95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37dfd053-a43a-4751-9b58-9fd0d11d3f95', 'volume_size': 1} Apr 28 19:17:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f81e6be9-d8a4-4a1e-8802-267411c3cf0f tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:17:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fbb8bb16-189e-4170-a87d-99b3fb99d118 tempest-SnapshotMetadataTestJSON-199548848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:17:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fbb8bb16-189e-4170-a87d-99b3fb99d118 tempest-SnapshotMetadataTestJSON-199548848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:17:38 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-fbb8bb16-189e-4170-a87d-99b3fb99d118 tempest-SnapshotMetadataTestJSON-199548848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:17:39 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-fbb8bb16-189e-4170-a87d-99b3fb99d118 tempest-SnapshotMetadataTestJSON-199548848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:17:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fbb8bb16-189e-4170-a87d-99b3fb99d118 tempest-SnapshotMetadataTestJSON-199548848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:17:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fbb8bb16-189e-4170-a87d-99b3fb99d118 tempest-SnapshotMetadataTestJSON-199548848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:39 devstack sudo[88378]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:39 devstack sudo[88448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:17:39 devstack sudo[88448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1b1fbf4f-187e-4fd6-a175-1d539002fbbd tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7c9ca9f3-3624-4528-9805-619e04833871 1073741824" returned: 0 in 1.756s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1b1fbf4f-187e-4fd6-a175-1d539002fbbd tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7c9ca9f3-3624-4528-9805-619e04833871 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:39 devstack sudo[88459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7c9ca9f3-3624-4528-9805-619e04833871 Apr 28 19:17:39 devstack sudo[88459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:39 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4518537-4717-4d1e-9c02-2a18f6e9f96a tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:17:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f4518537-4717-4d1e-9c02-2a18f6e9f96a tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Flow 'volume_create_manager' (3c35650c-4a15-4fdf-8e18-2487d6499a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:17:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f4518537-4717-4d1e-9c02-2a18f6e9f96a tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bde26ff7-a58b-4df1-9d71-6410dc7f4b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f4518537-4717-4d1e-9c02-2a18f6e9f96a tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bde26ff7-a58b-4df1-9d71-6410dc7f4b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:17:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1200460937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c7d00a5-fefa-4f9d-b7b5-21b055036d20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea247c1004da4ad58b762b011dbad901',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:17:39Z,use_quota=True,user_id='d1621fc748594438ae6400abe59c5d03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f4518537-4717-4d1e-9c02-2a18f6e9f96a tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1abdc55-73e4-4dfb-9252-97450d811686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f4518537-4717-4d1e-9c02-2a18f6e9f96a tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1abdc55-73e4-4dfb-9252-97450d811686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f4518537-4717-4d1e-9c02-2a18f6e9f96a tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fb0d3ad-998d-473a-8d99-6ccbb21c883d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f4518537-4717-4d1e-9c02-2a18f6e9f96a tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fb0d3ad-998d-473a-8d99-6ccbb21c883d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c7d00a5-fefa-4f9d-b7b5-21b055036d20', 'volume_name': 'volume-1c7d00a5-fefa-4f9d-b7b5-21b055036d20', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f4518537-4717-4d1e-9c02-2a18f6e9f96a tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dd3c6de-e27a-48b5-8173-dc362b03f5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f4518537-4717-4d1e-9c02-2a18f6e9f96a tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dd3c6de-e27a-48b5-8173-dc362b03f5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f4518537-4717-4d1e-9c02-2a18f6e9f96a tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8390c7de-3263-46d1-9219-422bc92b31eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:39 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-f4518537-4717-4d1e-9c02-2a18f6e9f96a tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Volume 1c7d00a5-fefa-4f9d-b7b5-21b055036d20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c7d00a5-fefa-4f9d-b7b5-21b055036d20', 'volume_size': 1} Apr 28 19:17:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f4518537-4717-4d1e-9c02-2a18f6e9f96a tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:17:39 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d1fec45c-1a14-48cb-9eb9-9124efcccd8e tempest-SnapshotsActionsTest-904821522 None] Acquiring lock "cinder-445eb71b-067e-4caa-af57-8763051e85fe-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:17:39 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d1fec45c-1a14-48cb-9eb9-9124efcccd8e tempest-SnapshotsActionsTest-904821522 None] Lock "cinder-445eb71b-067e-4caa-af57-8763051e85fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:17:39 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d1fec45c-1a14-48cb-9eb9-9124efcccd8e tempest-SnapshotsActionsTest-904821522 None] Acquiring lock "cinder-quobyte-da601bc0-f975-4bd3-8926-4b6098299f9d" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:17:39 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d1fec45c-1a14-48cb-9eb9-9124efcccd8e tempest-SnapshotsActionsTest-904821522 None] Lock "cinder-quobyte-da601bc0-f975-4bd3-8926-4b6098299f9d" acquired by "delete_snapshot" :: waited 0.024s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:17:39 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d1fec45c-1a14-48cb-9eb9-9124efcccd8e tempest-SnapshotsActionsTest-904821522 None] Acquiring lock "cinder-quobyte-445eb71b-067e-4caa-af57-8763051e85fe" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:17:39 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d1fec45c-1a14-48cb-9eb9-9124efcccd8e tempest-SnapshotsActionsTest-904821522 None] Lock "cinder-quobyte-445eb71b-067e-4caa-af57-8763051e85fe" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:17:39 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-d1fec45c-1a14-48cb-9eb9-9124efcccd8e tempest-SnapshotsActionsTest-904821522 None] Deleting offline snapshot 445eb71b-067e-4caa-af57-8763051e85fe of volume da601bc0-f975-4bd3-8926-4b6098299f9d {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 19:17:39 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-d1fec45c-1a14-48cb-9eb9-9124efcccd8e tempest-SnapshotsActionsTest-904821522 None] snapshot_file for this snap is: volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 19:17:39 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e2b679-24d1-4a3c-9228-f74fb3234934]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:17:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d1fec45c-1a14-48cb-9eb9-9124efcccd8e tempest-SnapshotsActionsTest-904821522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:39 devstack sudo[88462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe Apr 28 19:17:39 devstack sudo[88462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:40 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-d56ef03b-aa74-4d5e-b114-f9131d0a817d tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:17:40 devstack sudo[88448]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d56ef03b-aa74-4d5e-b114-f9131d0a817d tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Flow 'volume_create_manager' (fc455985-8277-433d-b5a3-1709c592112c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:17:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d56ef03b-aa74-4d5e-b114-f9131d0a817d tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (392b8e6a-4482-44a2-88af-032f739adf1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fbb8bb16-189e-4170-a87d-99b3fb99d118 tempest-SnapshotMetadataTestJSON-199548848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 1.428s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:40 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-fbb8bb16-189e-4170-a87d-99b3fb99d118 tempest-SnapshotMetadataTestJSON-199548848 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:17:40 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-fbb8bb16-189e-4170-a87d-99b3fb99d118 tempest-SnapshotMetadataTestJSON-199548848 None] Deleted volume successfully. Apr 28 19:17:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d56ef03b-aa74-4d5e-b114-f9131d0a817d tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (392b8e6a-4482-44a2-88af-032f739adf1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:17:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-883133106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bba65042-2bec-4563-bf89-571c472afafd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea247c1004da4ad58b762b011dbad901',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:17:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:17:40Z,use_quota=True,user_id='d1621fc748594438ae6400abe59c5d03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d56ef03b-aa74-4d5e-b114-f9131d0a817d tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (425ae8f8-9666-4232-b2b8-3f5087a4706d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d56ef03b-aa74-4d5e-b114-f9131d0a817d tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (425ae8f8-9666-4232-b2b8-3f5087a4706d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d56ef03b-aa74-4d5e-b114-f9131d0a817d tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24a1bab5-75ae-4383-8275-bd5cf3188d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d56ef03b-aa74-4d5e-b114-f9131d0a817d tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24a1bab5-75ae-4383-8275-bd5cf3188d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bba65042-2bec-4563-bf89-571c472afafd', 'volume_name': 'volume-bba65042-2bec-4563-bf89-571c472afafd', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:40 devstack sudo[88459]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d56ef03b-aa74-4d5e-b114-f9131d0a817d tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93dd61ad-5095-4460-92c0-ccf1621559af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d56ef03b-aa74-4d5e-b114-f9131d0a817d tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93dd61ad-5095-4460-92c0-ccf1621559af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d56ef03b-aa74-4d5e-b114-f9131d0a817d tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab2a984c-5f8b-4937-95bf-a88346bd752d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:40 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-d56ef03b-aa74-4d5e-b114-f9131d0a817d tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Volume bba65042-2bec-4563-bf89-571c472afafd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bba65042-2bec-4563-bf89-571c472afafd', 'volume_size': 1} Apr 28 19:17:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d56ef03b-aa74-4d5e-b114-f9131d0a817d tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:17:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1b1fbf4f-187e-4fd6-a175-1d539002fbbd tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7c9ca9f3-3624-4528-9805-619e04833871" returned: 0 in 1.539s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1b1fbf4f-187e-4fd6-a175-1d539002fbbd tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] <== create_volume: return (3385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:17:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1b1fbf4f-187e-4fd6-a175-1d539002fbbd tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.388s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:17:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0ffa6595-9033-4ab8-bf7f-48df6aa345ee tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.559s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:17:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0ffa6595-9033-4ab8-bf7f-48df6aa345ee tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1649197117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55ca4688-fd7b-4ef3-a3b3-d90fbd825171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea247c1004da4ad58b762b011dbad901',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:17:38Z,use_quota=True,user_id='d1621fc748594438ae6400abe59c5d03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:17:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-0ffa6595-9033-4ab8-bf7f-48df6aa345ee tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Creating volume 55ca4688-fd7b-4ef3-a3b3-d90fbd825171 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:17:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0ffa6595-9033-4ab8-bf7f-48df6aa345ee tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:17:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0ffa6595-9033-4ab8-bf7f-48df6aa345ee tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:17:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0ffa6595-9033-4ab8-bf7f-48df6aa345ee tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:17:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0ffa6595-9033-4ab8-bf7f-48df6aa345ee tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:17:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0ffa6595-9033-4ab8-bf7f-48df6aa345ee tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:17:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0ffa6595-9033-4ab8-bf7f-48df6aa345ee tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:17:40 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-0ffa6595-9033-4ab8-bf7f-48df6aa345ee tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:17:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0ffa6595-9033-4ab8-bf7f-48df6aa345ee tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55ca4688-fd7b-4ef3-a3b3-d90fbd825171 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:40 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-fbb8bb16-189e-4170-a87d-99b3fb99d118 tempest-SnapshotMetadataTestJSON-199548848 None] Lock "cinder-08938e0c-b4d2-4557-8179-a95a70fbce0d-delete_volume" released by "delete_volume" :: held 4.749s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:17:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1b1fbf4f-187e-4fd6-a175-1d539002fbbd tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9755003-a331-472f-b9e6-a41a56292722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c9ca9f3-3624-4528-9805-619e04833871', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1b1fbf4f-187e-4fd6-a175-1d539002fbbd tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a8eb314-7111-41c1-a56c-39d7f11eceec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:40 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-1b1fbf4f-187e-4fd6-a175-1d539002fbbd tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Volume volume-7c9ca9f3-3624-4528-9805-619e04833871 (7c9ca9f3-3624-4528-9805-619e04833871): created successfully Apr 28 19:17:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1b1fbf4f-187e-4fd6-a175-1d539002fbbd tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a8eb314-7111-41c1-a56c-39d7f11eceec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1b1fbf4f-187e-4fd6-a175-1d539002fbbd tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Flow 'volume_create_manager' (b9a108c5-8132-4f10-85b9-4276bf8db3f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:17:40 devstack sudo[88469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55ca4688-fd7b-4ef3-a3b3-d90fbd825171 1073741824 Apr 28 19:17:40 devstack sudo[88469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:40 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-1b1fbf4f-187e-4fd6-a175-1d539002fbbd tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Created volume successfully. Apr 28 19:17:41 devstack sudo[88462]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d1fec45c-1a14-48cb-9eb9-9124efcccd8e tempest-SnapshotsActionsTest-904821522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe" returned: 0 in 1.470s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:41 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-d1fec45c-1a14-48cb-9eb9-9124efcccd8e tempest-SnapshotsActionsTest-904821522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da601bc0-f975-4bd3-8926-4b6098299f9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:17:41 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[143a6dff-8837-4d50-9939-4a1ff4d91f02]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:17:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d1fec45c-1a14-48cb-9eb9-9124efcccd8e tempest-SnapshotsActionsTest-904821522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:41 devstack sudo[88475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d Apr 28 19:17:41 devstack sudo[88475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:41 devstack sudo[88469]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0ffa6595-9033-4ab8-bf7f-48df6aa345ee tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55ca4688-fd7b-4ef3-a3b3-d90fbd825171 1073741824" returned: 0 in 1.069s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0ffa6595-9033-4ab8-bf7f-48df6aa345ee tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55ca4688-fd7b-4ef3-a3b3-d90fbd825171 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:41 devstack sudo[88480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55ca4688-fd7b-4ef3-a3b3-d90fbd825171 Apr 28 19:17:41 devstack sudo[88480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:42 devstack sudo[88475]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d1fec45c-1a14-48cb-9eb9-9124efcccd8e tempest-SnapshotsActionsTest-904821522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d" returned: 0 in 0.933s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d1fec45c-1a14-48cb-9eb9-9124efcccd8e tempest-SnapshotsActionsTest-904821522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:42 devstack sudo[88485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe Apr 28 19:17:42 devstack sudo[88485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:42 devstack sudo[88480]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0ffa6595-9033-4ab8-bf7f-48df6aa345ee tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55ca4688-fd7b-4ef3-a3b3-d90fbd825171" returned: 0 in 0.739s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:42 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0ffa6595-9033-4ab8-bf7f-48df6aa345ee tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] <== create_volume: return (1902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:17:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0ffa6595-9033-4ab8-bf7f-48df6aa345ee tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.907s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:17:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f81e6be9-d8a4-4a1e-8802-267411c3cf0f tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.658s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:17:42 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f81e6be9-d8a4-4a1e-8802-267411c3cf0f tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-237828661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37dfd053-a43a-4751-9b58-9fd0d11d3f95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea247c1004da4ad58b762b011dbad901',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:17:39Z,use_quota=True,user_id='d1621fc748594438ae6400abe59c5d03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:17:42 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-f81e6be9-d8a4-4a1e-8802-267411c3cf0f tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Creating volume 37dfd053-a43a-4751-9b58-9fd0d11d3f95 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:17:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f81e6be9-d8a4-4a1e-8802-267411c3cf0f tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:17:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f81e6be9-d8a4-4a1e-8802-267411c3cf0f tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:17:42 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f81e6be9-d8a4-4a1e-8802-267411c3cf0f tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:17:42 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f81e6be9-d8a4-4a1e-8802-267411c3cf0f tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:17:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f81e6be9-d8a4-4a1e-8802-267411c3cf0f tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:17:42 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f81e6be9-d8a4-4a1e-8802-267411c3cf0f tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:17:42 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-f81e6be9-d8a4-4a1e-8802-267411c3cf0f tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:17:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f81e6be9-d8a4-4a1e-8802-267411c3cf0f tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-37dfd053-a43a-4751-9b58-9fd0d11d3f95 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:42 devstack sudo[88488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-37dfd053-a43a-4751-9b58-9fd0d11d3f95 1073741824 Apr 28 19:17:42 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0ffa6595-9033-4ab8-bf7f-48df6aa345ee tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b5722c2-d6b0-488e-928c-5d16ca6d6203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55ca4688-fd7b-4ef3-a3b3-d90fbd825171', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:42 devstack sudo[88488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:42 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0ffa6595-9033-4ab8-bf7f-48df6aa345ee tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (659bb44c-d05d-48dd-a34d-a1eb6a71033e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:42 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-0ffa6595-9033-4ab8-bf7f-48df6aa345ee tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Volume volume-55ca4688-fd7b-4ef3-a3b3-d90fbd825171 (55ca4688-fd7b-4ef3-a3b3-d90fbd825171): created successfully Apr 28 19:17:42 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0ffa6595-9033-4ab8-bf7f-48df6aa345ee tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (659bb44c-d05d-48dd-a34d-a1eb6a71033e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:42 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0ffa6595-9033-4ab8-bf7f-48df6aa345ee tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Flow 'volume_create_manager' (ec00cd0a-70f0-4f6e-83b5-7d46d1f91ed6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:17:42 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-0ffa6595-9033-4ab8-bf7f-48df6aa345ee tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Created volume successfully. Apr 28 19:17:43 devstack sudo[88485]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d1fec45c-1a14-48cb-9eb9-9124efcccd8e tempest-SnapshotsActionsTest-904821522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe" returned: 0 in 0.979s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d1fec45c-1a14-48cb-9eb9-9124efcccd8e tempest-SnapshotsActionsTest-904821522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:43 devstack sudo[88495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe Apr 28 19:17:43 devstack sudo[88495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:43 devstack sudo[88488]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f81e6be9-d8a4-4a1e-8802-267411c3cf0f tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-37dfd053-a43a-4751-9b58-9fd0d11d3f95 1073741824" returned: 0 in 1.091s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f81e6be9-d8a4-4a1e-8802-267411c3cf0f tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-37dfd053-a43a-4751-9b58-9fd0d11d3f95 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:43 devstack sudo[88505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-37dfd053-a43a-4751-9b58-9fd0d11d3f95 Apr 28 19:17:43 devstack sudo[88505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:43 devstack sudo[88495]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d1fec45c-1a14-48cb-9eb9-9124efcccd8e tempest-SnapshotsActionsTest-904821522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d.445eb71b-067e-4caa-af57-8763051e85fe" returned: 0 in 0.872s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:44 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d1fec45c-1a14-48cb-9eb9-9124efcccd8e tempest-SnapshotsActionsTest-904821522 None] Lock "cinder-quobyte-445eb71b-067e-4caa-af57-8763051e85fe" released by "_delete_snapshot" :: held 4.443s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:17:44 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d1fec45c-1a14-48cb-9eb9-9124efcccd8e tempest-SnapshotsActionsTest-904821522 None] Lock "cinder-quobyte-da601bc0-f975-4bd3-8926-4b6098299f9d" released by "delete_snapshot" :: held 4.474s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:17:44 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-d1fec45c-1a14-48cb-9eb9-9124efcccd8e tempest-SnapshotsActionsTest-904821522 None] Created reservations ['b41f3e8f-e680-4b5a-90d1-d84884676e2a', 'bf1e9a50-9397-4fdb-8a0d-184afc589a95', '1d7c5168-bd99-458c-a8b4-a899553c5078', '57894565-d089-4202-ae4e-b8cff7bc69bc'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:17:44 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-d1fec45c-1a14-48cb-9eb9-9124efcccd8e tempest-SnapshotsActionsTest-904821522 None] Delete snapshot completed successfully. Apr 28 19:17:44 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d1fec45c-1a14-48cb-9eb9-9124efcccd8e tempest-SnapshotsActionsTest-904821522 None] Lock "cinder-445eb71b-067e-4caa-af57-8763051e85fe-delete_snapshot" released by "delete_snapshot" :: held 4.690s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:17:44 devstack sudo[88505]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f81e6be9-d8a4-4a1e-8802-267411c3cf0f tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-37dfd053-a43a-4751-9b58-9fd0d11d3f95" returned: 0 in 0.678s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:44 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f81e6be9-d8a4-4a1e-8802-267411c3cf0f tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] <== create_volume: return (1818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:17:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f81e6be9-d8a4-4a1e-8802-267411c3cf0f tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.822s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:17:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f4518537-4717-4d1e-9c02-2a18f6e9f96a tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.933s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:17:44 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f4518537-4717-4d1e-9c02-2a18f6e9f96a tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:17:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1200460937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c7d00a5-fefa-4f9d-b7b5-21b055036d20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea247c1004da4ad58b762b011dbad901',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:17:39Z,use_quota=True,user_id='d1621fc748594438ae6400abe59c5d03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:17:44 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-f4518537-4717-4d1e-9c02-2a18f6e9f96a tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Creating volume 1c7d00a5-fefa-4f9d-b7b5-21b055036d20 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:17:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f4518537-4717-4d1e-9c02-2a18f6e9f96a tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:17:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f4518537-4717-4d1e-9c02-2a18f6e9f96a tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:17:44 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f4518537-4717-4d1e-9c02-2a18f6e9f96a tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:17:44 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f4518537-4717-4d1e-9c02-2a18f6e9f96a tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:17:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f4518537-4717-4d1e-9c02-2a18f6e9f96a tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:17:44 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f4518537-4717-4d1e-9c02-2a18f6e9f96a tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:17:44 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-f4518537-4717-4d1e-9c02-2a18f6e9f96a tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:17:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f4518537-4717-4d1e-9c02-2a18f6e9f96a tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1c7d00a5-fefa-4f9d-b7b5-21b055036d20 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:44 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f81e6be9-d8a4-4a1e-8802-267411c3cf0f tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d8b1ff7-74cf-4ef3-b545-8e787e64bad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37dfd053-a43a-4751-9b58-9fd0d11d3f95', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:44 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f81e6be9-d8a4-4a1e-8802-267411c3cf0f tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cd7e712-9f9b-46a5-985c-c984cab30e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:44 devstack sudo[88511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1c7d00a5-fefa-4f9d-b7b5-21b055036d20 1073741824 Apr 28 19:17:44 devstack sudo[88511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:44 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-f81e6be9-d8a4-4a1e-8802-267411c3cf0f tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Volume volume-37dfd053-a43a-4751-9b58-9fd0d11d3f95 (37dfd053-a43a-4751-9b58-9fd0d11d3f95): created successfully Apr 28 19:17:44 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f81e6be9-d8a4-4a1e-8802-267411c3cf0f tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cd7e712-9f9b-46a5-985c-c984cab30e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:44 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f81e6be9-d8a4-4a1e-8802-267411c3cf0f tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Flow 'volume_create_manager' (807fddcd-4033-49e6-a072-3524673b9e33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:17:44 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-f81e6be9-d8a4-4a1e-8802-267411c3cf0f tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Created volume successfully. Apr 28 19:17:45 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-70a24c43-041e-48c6-bc4d-99833b6e9545 tempest-SnapshotsActionsTest-904821522 None] Acquiring lock "cinder-da601bc0-f975-4bd3-8926-4b6098299f9d-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:17:45 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-70a24c43-041e-48c6-bc4d-99833b6e9545 tempest-SnapshotsActionsTest-904821522 None] Lock "cinder-da601bc0-f975-4bd3-8926-4b6098299f9d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:17:45 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-70a24c43-041e-48c6-bc4d-99833b6e9545 tempest-SnapshotsActionsTest-904821522 None] Acquiring lock "cinder-quobyte-da601bc0-f975-4bd3-8926-4b6098299f9d" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:17:45 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-70a24c43-041e-48c6-bc4d-99833b6e9545 tempest-SnapshotsActionsTest-904821522 None] Lock "cinder-quobyte-da601bc0-f975-4bd3-8926-4b6098299f9d" acquired by "delete_volume" :: waited 0.016s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:17:45 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d8258b-cf1a-43ff-81ff-7a84d0b29911]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:17:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-70a24c43-041e-48c6-bc4d-99833b6e9545 tempest-SnapshotsActionsTest-904821522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:45 devstack sudo[88516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d Apr 28 19:17:45 devstack sudo[88516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:45 devstack sudo[88511]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f4518537-4717-4d1e-9c02-2a18f6e9f96a tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1c7d00a5-fefa-4f9d-b7b5-21b055036d20 1073741824" returned: 0 in 0.991s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f4518537-4717-4d1e-9c02-2a18f6e9f96a tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1c7d00a5-fefa-4f9d-b7b5-21b055036d20 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:45 devstack sudo[88524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1c7d00a5-fefa-4f9d-b7b5-21b055036d20 Apr 28 19:17:45 devstack sudo[88524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:45 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee7b62f2-1272-456f-a935-2996222f2910 tempest-VolumesTransfersV355Test-975964247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:17:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ee7b62f2-1272-456f-a935-2996222f2910 tempest-VolumesTransfersV355Test-975964247 None] Flow 'volume_create_manager' (c46ab58c-6fd1-4388-afef-10654ca92433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:17:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ee7b62f2-1272-456f-a935-2996222f2910 tempest-VolumesTransfersV355Test-975964247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e879b901-fffa-4d84-827d-1be0f6cf7849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ee7b62f2-1272-456f-a935-2996222f2910 tempest-VolumesTransfersV355Test-975964247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e879b901-fffa-4d84-827d-1be0f6cf7849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:17:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-756720643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc302b40-bf34-4dc0-8148-4ee457a21569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f386c88d70a84949b9c898a41a099e86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:17:46Z,use_quota=True,user_id='68bd054afa9d477d95fae1f5e34ee7fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ee7b62f2-1272-456f-a935-2996222f2910 tempest-VolumesTransfersV355Test-975964247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59e57a8b-5f63-4f53-9838-89c6c2c44f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ee7b62f2-1272-456f-a935-2996222f2910 tempest-VolumesTransfersV355Test-975964247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59e57a8b-5f63-4f53-9838-89c6c2c44f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ee7b62f2-1272-456f-a935-2996222f2910 tempest-VolumesTransfersV355Test-975964247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03700ea6-b05e-4a12-9ebc-0b359eaeaf34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ee7b62f2-1272-456f-a935-2996222f2910 tempest-VolumesTransfersV355Test-975964247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03700ea6-b05e-4a12-9ebc-0b359eaeaf34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc302b40-bf34-4dc0-8148-4ee457a21569', 'volume_name': 'volume-fc302b40-bf34-4dc0-8148-4ee457a21569', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ee7b62f2-1272-456f-a935-2996222f2910 tempest-VolumesTransfersV355Test-975964247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56558f6d-f288-4ff4-a099-465e020deb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ee7b62f2-1272-456f-a935-2996222f2910 tempest-VolumesTransfersV355Test-975964247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56558f6d-f288-4ff4-a099-465e020deb89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ee7b62f2-1272-456f-a935-2996222f2910 tempest-VolumesTransfersV355Test-975964247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (188bb21f-8872-47f1-9187-e75e352ba91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:45 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-ee7b62f2-1272-456f-a935-2996222f2910 tempest-VolumesTransfersV355Test-975964247 None] Volume fc302b40-bf34-4dc0-8148-4ee457a21569: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc302b40-bf34-4dc0-8148-4ee457a21569', 'volume_size': 1} Apr 28 19:17:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ee7b62f2-1272-456f-a935-2996222f2910 tempest-VolumesTransfersV355Test-975964247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:17:45 devstack sudo[88516]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-70a24c43-041e-48c6-bc4d-99833b6e9545 tempest-SnapshotsActionsTest-904821522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d" returned: 0 in 0.813s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-70a24c43-041e-48c6-bc4d-99833b6e9545 tempest-SnapshotsActionsTest-904821522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:46 devstack sudo[88529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d Apr 28 19:17:46 devstack sudo[88529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:46 devstack sudo[88524]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f4518537-4717-4d1e-9c02-2a18f6e9f96a tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1c7d00a5-fefa-4f9d-b7b5-21b055036d20" returned: 0 in 0.660s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:46 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f4518537-4717-4d1e-9c02-2a18f6e9f96a tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] <== create_volume: return (1707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:17:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f4518537-4717-4d1e-9c02-2a18f6e9f96a tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.711s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:17:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d56ef03b-aa74-4d5e-b114-f9131d0a817d tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.470s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:17:46 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d56ef03b-aa74-4d5e-b114-f9131d0a817d tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:17:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-883133106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bba65042-2bec-4563-bf89-571c472afafd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea247c1004da4ad58b762b011dbad901',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:17:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:17:40Z,use_quota=True,user_id='d1621fc748594438ae6400abe59c5d03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:17:46 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-d56ef03b-aa74-4d5e-b114-f9131d0a817d tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Creating volume bba65042-2bec-4563-bf89-571c472afafd {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:17:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d56ef03b-aa74-4d5e-b114-f9131d0a817d tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:17:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d56ef03b-aa74-4d5e-b114-f9131d0a817d tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:17:46 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d56ef03b-aa74-4d5e-b114-f9131d0a817d tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:17:46 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d56ef03b-aa74-4d5e-b114-f9131d0a817d tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:17:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d56ef03b-aa74-4d5e-b114-f9131d0a817d tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:17:46 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d56ef03b-aa74-4d5e-b114-f9131d0a817d tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:17:46 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-d56ef03b-aa74-4d5e-b114-f9131d0a817d tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:17:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d56ef03b-aa74-4d5e-b114-f9131d0a817d tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bba65042-2bec-4563-bf89-571c472afafd 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:46 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f4518537-4717-4d1e-9c02-2a18f6e9f96a tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8390c7de-3263-46d1-9219-422bc92b31eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c7d00a5-fefa-4f9d-b7b5-21b055036d20', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:46 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f4518537-4717-4d1e-9c02-2a18f6e9f96a tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d80e4ac-a89e-4518-8b11-41596b97ab23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:46 devstack sudo[88532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bba65042-2bec-4563-bf89-571c472afafd 1073741824 Apr 28 19:17:46 devstack sudo[88532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:46 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-f4518537-4717-4d1e-9c02-2a18f6e9f96a tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Volume volume-1c7d00a5-fefa-4f9d-b7b5-21b055036d20 (1c7d00a5-fefa-4f9d-b7b5-21b055036d20): created successfully Apr 28 19:17:46 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f4518537-4717-4d1e-9c02-2a18f6e9f96a tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d80e4ac-a89e-4518-8b11-41596b97ab23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:46 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f4518537-4717-4d1e-9c02-2a18f6e9f96a tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Flow 'volume_create_manager' (3c35650c-4a15-4fdf-8e18-2487d6499a14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:17:46 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-f4518537-4717-4d1e-9c02-2a18f6e9f96a tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Created volume successfully. Apr 28 19:17:46 devstack sudo[88529]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-70a24c43-041e-48c6-bc4d-99833b6e9545 tempest-SnapshotsActionsTest-904821522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-da601bc0-f975-4bd3-8926-4b6098299f9d" returned: 0 in 0.645s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:46 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-70a24c43-041e-48c6-bc4d-99833b6e9545 tempest-SnapshotsActionsTest-904821522 None] Lock "cinder-quobyte-da601bc0-f975-4bd3-8926-4b6098299f9d" released by "delete_volume" :: held 1.519s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:17:46 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-70a24c43-041e-48c6-bc4d-99833b6e9545 tempest-SnapshotsActionsTest-904821522 None] Created reservations ['f41737e0-9381-4c89-84a2-51a94a9b4dc4', '52e65d64-93b6-41f9-8697-165bfe02d04b', '32a99be8-5323-4b7a-a08e-10e8e457b67f', 'c8fcd3c8-ae38-418a-b2fe-cd2463566853'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:17:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-70a24c43-041e-48c6-bc4d-99833b6e9545 tempest-SnapshotsActionsTest-904821522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:17:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-70a24c43-041e-48c6-bc4d-99833b6e9545 tempest-SnapshotsActionsTest-904821522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:17:46 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-70a24c43-041e-48c6-bc4d-99833b6e9545 tempest-SnapshotsActionsTest-904821522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:17:46 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-70a24c43-041e-48c6-bc4d-99833b6e9545 tempest-SnapshotsActionsTest-904821522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:17:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-70a24c43-041e-48c6-bc4d-99833b6e9545 tempest-SnapshotsActionsTest-904821522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:17:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-70a24c43-041e-48c6-bc4d-99833b6e9545 tempest-SnapshotsActionsTest-904821522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:46 devstack sudo[88538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:17:46 devstack sudo[88538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:47 devstack sudo[88532]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d56ef03b-aa74-4d5e-b114-f9131d0a817d tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bba65042-2bec-4563-bf89-571c472afafd 1073741824" returned: 0 in 0.893s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d56ef03b-aa74-4d5e-b114-f9131d0a817d tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bba65042-2bec-4563-bf89-571c472afafd {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:47 devstack sudo[88542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bba65042-2bec-4563-bf89-571c472afafd Apr 28 19:17:47 devstack sudo[88542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:47 devstack sudo[88538]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-70a24c43-041e-48c6-bc4d-99833b6e9545 tempest-SnapshotsActionsTest-904821522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.645s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:47 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-70a24c43-041e-48c6-bc4d-99833b6e9545 tempest-SnapshotsActionsTest-904821522 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:17:47 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-70a24c43-041e-48c6-bc4d-99833b6e9545 tempest-SnapshotsActionsTest-904821522 None] Deleted volume successfully. Apr 28 19:17:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-70a24c43-041e-48c6-bc4d-99833b6e9545 tempest-SnapshotsActionsTest-904821522 None] Lock "cinder-da601bc0-f975-4bd3-8926-4b6098299f9d-delete_volume" released by "delete_volume" :: held 2.398s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:17:47 devstack sudo[88542]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d56ef03b-aa74-4d5e-b114-f9131d0a817d tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bba65042-2bec-4563-bf89-571c472afafd" returned: 0 in 0.638s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:47 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d56ef03b-aa74-4d5e-b114-f9131d0a817d tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] <== create_volume: return (1577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:17:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d56ef03b-aa74-4d5e-b114-f9131d0a817d tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:17:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ee7b62f2-1272-456f-a935-2996222f2910 tempest-VolumesTransfersV355Test-975964247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.083s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:17:47 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ee7b62f2-1272-456f-a935-2996222f2910 tempest-VolumesTransfersV355Test-975964247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:17:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-756720643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc302b40-bf34-4dc0-8148-4ee457a21569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f386c88d70a84949b9c898a41a099e86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:17:46Z,use_quota=True,user_id='68bd054afa9d477d95fae1f5e34ee7fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:17:47 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-ee7b62f2-1272-456f-a935-2996222f2910 tempest-VolumesTransfersV355Test-975964247 None] Creating volume fc302b40-bf34-4dc0-8148-4ee457a21569 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:17:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ee7b62f2-1272-456f-a935-2996222f2910 tempest-VolumesTransfersV355Test-975964247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:17:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ee7b62f2-1272-456f-a935-2996222f2910 tempest-VolumesTransfersV355Test-975964247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:17:47 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ee7b62f2-1272-456f-a935-2996222f2910 tempest-VolumesTransfersV355Test-975964247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:17:47 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ee7b62f2-1272-456f-a935-2996222f2910 tempest-VolumesTransfersV355Test-975964247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:17:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ee7b62f2-1272-456f-a935-2996222f2910 tempest-VolumesTransfersV355Test-975964247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:17:47 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ee7b62f2-1272-456f-a935-2996222f2910 tempest-VolumesTransfersV355Test-975964247 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:17:47 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-ee7b62f2-1272-456f-a935-2996222f2910 tempest-VolumesTransfersV355Test-975964247 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:17:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ee7b62f2-1272-456f-a935-2996222f2910 tempest-VolumesTransfersV355Test-975964247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fc302b40-bf34-4dc0-8148-4ee457a21569 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d56ef03b-aa74-4d5e-b114-f9131d0a817d tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab2a984c-5f8b-4937-95bf-a88346bd752d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bba65042-2bec-4563-bf89-571c472afafd', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d56ef03b-aa74-4d5e-b114-f9131d0a817d tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (441a0544-e766-4ff2-ad0a-0dfaddc81804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:47 devstack sudo[88546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fc302b40-bf34-4dc0-8148-4ee457a21569 1073741824 Apr 28 19:17:47 devstack sudo[88546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:47 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-d56ef03b-aa74-4d5e-b114-f9131d0a817d tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Volume volume-bba65042-2bec-4563-bf89-571c472afafd (bba65042-2bec-4563-bf89-571c472afafd): created successfully Apr 28 19:17:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d56ef03b-aa74-4d5e-b114-f9131d0a817d tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (441a0544-e766-4ff2-ad0a-0dfaddc81804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d56ef03b-aa74-4d5e-b114-f9131d0a817d tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Flow 'volume_create_manager' (fc455985-8277-433d-b5a3-1709c592112c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:17:47 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-d56ef03b-aa74-4d5e-b114-f9131d0a817d tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Created volume successfully. Apr 28 19:17:48 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-f5ba49a7-1b40-4de5-9f3e-daaaffd3e614 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Acquiring lock "cinder-bba65042-2bec-4563-bf89-571c472afafd-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:17:48 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-f5ba49a7-1b40-4de5-9f3e-daaaffd3e614 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "cinder-bba65042-2bec-4563-bf89-571c472afafd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:17:48 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-f5ba49a7-1b40-4de5-9f3e-daaaffd3e614 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Acquiring lock "cinder-quobyte-bba65042-2bec-4563-bf89-571c472afafd" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:17:48 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-f5ba49a7-1b40-4de5-9f3e-daaaffd3e614 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "cinder-quobyte-bba65042-2bec-4563-bf89-571c472afafd" acquired by "delete_volume" :: waited 0.029s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:17:48 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df6934b-007e-4a5f-a345-3e176a27387e]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:17:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f5ba49a7-1b40-4de5-9f3e-daaaffd3e614 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bba65042-2bec-4563-bf89-571c472afafd {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:48 devstack sudo[88549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bba65042-2bec-4563-bf89-571c472afafd Apr 28 19:17:48 devstack sudo[88549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:48 devstack sudo[88546]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ee7b62f2-1272-456f-a935-2996222f2910 tempest-VolumesTransfersV355Test-975964247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fc302b40-bf34-4dc0-8148-4ee457a21569 1073741824" returned: 0 in 1.127s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ee7b62f2-1272-456f-a935-2996222f2910 tempest-VolumesTransfersV355Test-975964247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fc302b40-bf34-4dc0-8148-4ee457a21569 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:48 devstack sudo[88555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fc302b40-bf34-4dc0-8148-4ee457a21569 Apr 28 19:17:48 devstack sudo[88555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:49 devstack sudo[88549]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f5ba49a7-1b40-4de5-9f3e-daaaffd3e614 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bba65042-2bec-4563-bf89-571c472afafd" returned: 0 in 1.026s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f5ba49a7-1b40-4de5-9f3e-daaaffd3e614 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bba65042-2bec-4563-bf89-571c472afafd {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:49 devstack sudo[88560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bba65042-2bec-4563-bf89-571c472afafd Apr 28 19:17:49 devstack sudo[88560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:49 devstack sudo[88555]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ee7b62f2-1272-456f-a935-2996222f2910 tempest-VolumesTransfersV355Test-975964247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fc302b40-bf34-4dc0-8148-4ee457a21569" returned: 0 in 0.998s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:49 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ee7b62f2-1272-456f-a935-2996222f2910 tempest-VolumesTransfersV355Test-975964247 None] <== create_volume: return (2174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:17:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ee7b62f2-1272-456f-a935-2996222f2910 tempest-VolumesTransfersV355Test-975964247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.177s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:17:49 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ee7b62f2-1272-456f-a935-2996222f2910 tempest-VolumesTransfersV355Test-975964247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (188bb21f-8872-47f1-9187-e75e352ba91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc302b40-bf34-4dc0-8148-4ee457a21569', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:49 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ee7b62f2-1272-456f-a935-2996222f2910 tempest-VolumesTransfersV355Test-975964247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b80b26b-9c72-4c01-846b-c22cb496bd7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:49 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-ee7b62f2-1272-456f-a935-2996222f2910 tempest-VolumesTransfersV355Test-975964247 None] Volume volume-fc302b40-bf34-4dc0-8148-4ee457a21569 (fc302b40-bf34-4dc0-8148-4ee457a21569): created successfully Apr 28 19:17:49 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ee7b62f2-1272-456f-a935-2996222f2910 tempest-VolumesTransfersV355Test-975964247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b80b26b-9c72-4c01-846b-c22cb496bd7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:50 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ee7b62f2-1272-456f-a935-2996222f2910 tempest-VolumesTransfersV355Test-975964247 None] Flow 'volume_create_manager' (c46ab58c-6fd1-4388-afef-10654ca92433) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:17:50 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-ee7b62f2-1272-456f-a935-2996222f2910 tempest-VolumesTransfersV355Test-975964247 None] Created volume successfully. Apr 28 19:17:50 devstack sudo[88560]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f5ba49a7-1b40-4de5-9f3e-daaaffd3e614 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bba65042-2bec-4563-bf89-571c472afafd" returned: 0 in 0.813s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:50 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-f5ba49a7-1b40-4de5-9f3e-daaaffd3e614 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "cinder-quobyte-bba65042-2bec-4563-bf89-571c472afafd" released by "delete_volume" :: held 1.900s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:17:50 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-f5ba49a7-1b40-4de5-9f3e-daaaffd3e614 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Created reservations ['5f040f1d-2eae-46d4-8bd7-6ac99d8353eb', 'a9c7e3f6-55bb-4508-81e0-009e9c1bb404', 'cde105ae-5aa8-442d-b79f-f0c086b10886', '10f52b8f-bafe-4da8-a1a6-2f0f8adac85f'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:17:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f5ba49a7-1b40-4de5-9f3e-daaaffd3e614 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:17:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f5ba49a7-1b40-4de5-9f3e-daaaffd3e614 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:17:50 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f5ba49a7-1b40-4de5-9f3e-daaaffd3e614 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:17:50 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f5ba49a7-1b40-4de5-9f3e-daaaffd3e614 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:17:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f5ba49a7-1b40-4de5-9f3e-daaaffd3e614 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:17:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f5ba49a7-1b40-4de5-9f3e-daaaffd3e614 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:50 devstack sudo[88568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:17:50 devstack sudo[88568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:50 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-f8e49579-2deb-42c1-ad85-cd9a1c3c0354 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Acquiring lock "cinder-1c7d00a5-fefa-4f9d-b7b5-21b055036d20-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:17:50 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-f8e49579-2deb-42c1-ad85-cd9a1c3c0354 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "cinder-1c7d00a5-fefa-4f9d-b7b5-21b055036d20-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:17:50 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-f8e49579-2deb-42c1-ad85-cd9a1c3c0354 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Acquiring lock "cinder-quobyte-1c7d00a5-fefa-4f9d-b7b5-21b055036d20" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:17:50 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-f8e49579-2deb-42c1-ad85-cd9a1c3c0354 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "cinder-quobyte-1c7d00a5-fefa-4f9d-b7b5-21b055036d20" acquired by "delete_volume" :: waited 0.029s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:17:50 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa63954c-e92d-4a34-90ea-ba0b3372b57e]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:17:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f8e49579-2deb-42c1-ad85-cd9a1c3c0354 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1c7d00a5-fefa-4f9d-b7b5-21b055036d20 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:50 devstack sudo[88583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1c7d00a5-fefa-4f9d-b7b5-21b055036d20 Apr 28 19:17:51 devstack sudo[88583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:51 devstack sudo[88568]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f5ba49a7-1b40-4de5-9f3e-daaaffd3e614 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.843s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:51 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-f5ba49a7-1b40-4de5-9f3e-daaaffd3e614 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:17:51 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-f5ba49a7-1b40-4de5-9f3e-daaaffd3e614 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Deleted volume successfully. Apr 28 19:17:51 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-f5ba49a7-1b40-4de5-9f3e-daaaffd3e614 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "cinder-bba65042-2bec-4563-bf89-571c472afafd-delete_volume" released by "delete_volume" :: held 3.014s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:17:51 devstack sudo[88583]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f8e49579-2deb-42c1-ad85-cd9a1c3c0354 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1c7d00a5-fefa-4f9d-b7b5-21b055036d20" returned: 0 in 0.897s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f8e49579-2deb-42c1-ad85-cd9a1c3c0354 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1c7d00a5-fefa-4f9d-b7b5-21b055036d20 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:51 devstack sudo[88593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1c7d00a5-fefa-4f9d-b7b5-21b055036d20 Apr 28 19:17:51 devstack sudo[88593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:51 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-5b2b375a-c91b-48d0-b64f-e8b8b902d224 tempest-VolumesTransfersV355Test-1923089718 None] Transfer volume completed successfully. Apr 28 19:17:52 devstack sudo[88593]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f8e49579-2deb-42c1-ad85-cd9a1c3c0354 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1c7d00a5-fefa-4f9d-b7b5-21b055036d20" returned: 0 in 0.649s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-f8e49579-2deb-42c1-ad85-cd9a1c3c0354 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "cinder-quobyte-1c7d00a5-fefa-4f9d-b7b5-21b055036d20" released by "delete_volume" :: held 1.605s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:17:52 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-f8e49579-2deb-42c1-ad85-cd9a1c3c0354 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Created reservations ['0acb94e9-a84c-4519-9a85-69aa2049af45', 'df131918-b593-4c87-9794-82a4fece1251', '44cfdeb9-c4c3-4300-9516-0513ba944244', '450237f7-cd05-4c38-96f8-dc050295a3e2'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:17:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f8e49579-2deb-42c1-ad85-cd9a1c3c0354 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:17:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f8e49579-2deb-42c1-ad85-cd9a1c3c0354 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:17:52 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f8e49579-2deb-42c1-ad85-cd9a1c3c0354 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:17:52 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f8e49579-2deb-42c1-ad85-cd9a1c3c0354 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:17:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f8e49579-2deb-42c1-ad85-cd9a1c3c0354 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:17:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f8e49579-2deb-42c1-ad85-cd9a1c3c0354 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:52 devstack sudo[88596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:17:52 devstack sudo[88596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:53 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2015bff2-2671-447f-bcf9-aa65048e659f tempest-VolumesTransfersV355Test-257731320 None] Acquiring lock "cinder-fc302b40-bf34-4dc0-8148-4ee457a21569-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:17:53 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2015bff2-2671-447f-bcf9-aa65048e659f tempest-VolumesTransfersV355Test-257731320 None] Lock "cinder-fc302b40-bf34-4dc0-8148-4ee457a21569-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:17:53 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2015bff2-2671-447f-bcf9-aa65048e659f tempest-VolumesTransfersV355Test-257731320 None] Acquiring lock "cinder-quobyte-fc302b40-bf34-4dc0-8148-4ee457a21569" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:17:53 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2015bff2-2671-447f-bcf9-aa65048e659f tempest-VolumesTransfersV355Test-257731320 None] Lock "cinder-quobyte-fc302b40-bf34-4dc0-8148-4ee457a21569" acquired by "delete_volume" :: waited 0.021s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:17:53 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d96a32-99e1-4b00-8db8-c285bbc583c7]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:17:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2015bff2-2671-447f-bcf9-aa65048e659f tempest-VolumesTransfersV355Test-257731320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fc302b40-bf34-4dc0-8148-4ee457a21569 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:53 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-86cb5425-7687-4a75-a627-dd4e2567f1d8 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Acquiring lock "cinder-37dfd053-a43a-4751-9b58-9fd0d11d3f95-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:17:53 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-86cb5425-7687-4a75-a627-dd4e2567f1d8 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "cinder-37dfd053-a43a-4751-9b58-9fd0d11d3f95-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:17:53 devstack sudo[88598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fc302b40-bf34-4dc0-8148-4ee457a21569 Apr 28 19:17:53 devstack sudo[88598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:53 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-86cb5425-7687-4a75-a627-dd4e2567f1d8 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Acquiring lock "cinder-quobyte-37dfd053-a43a-4751-9b58-9fd0d11d3f95" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:17:53 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-86cb5425-7687-4a75-a627-dd4e2567f1d8 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "cinder-quobyte-37dfd053-a43a-4751-9b58-9fd0d11d3f95" acquired by "delete_volume" :: waited 0.020s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:17:53 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4d43ca-d846-49f5-b068-895bee0a32fb]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:17:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-86cb5425-7687-4a75-a627-dd4e2567f1d8 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-37dfd053-a43a-4751-9b58-9fd0d11d3f95 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:53 devstack sudo[88596]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f8e49579-2deb-42c1-ad85-cd9a1c3c0354 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.998s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:53 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-f8e49579-2deb-42c1-ad85-cd9a1c3c0354 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:17:53 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-f8e49579-2deb-42c1-ad85-cd9a1c3c0354 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Deleted volume successfully. Apr 28 19:17:53 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-f8e49579-2deb-42c1-ad85-cd9a1c3c0354 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "cinder-1c7d00a5-fefa-4f9d-b7b5-21b055036d20-delete_volume" released by "delete_volume" :: held 2.967s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:17:53 devstack sudo[88601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-37dfd053-a43a-4751-9b58-9fd0d11d3f95 Apr 28 19:17:53 devstack sudo[88601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:54 devstack sudo[88598]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2015bff2-2671-447f-bcf9-aa65048e659f tempest-VolumesTransfersV355Test-257731320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fc302b40-bf34-4dc0-8148-4ee457a21569" returned: 0 in 0.970s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2015bff2-2671-447f-bcf9-aa65048e659f tempest-VolumesTransfersV355Test-257731320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fc302b40-bf34-4dc0-8148-4ee457a21569 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:54 devstack sudo[88608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fc302b40-bf34-4dc0-8148-4ee457a21569 Apr 28 19:17:54 devstack sudo[88608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:54 devstack sudo[88601]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-86cb5425-7687-4a75-a627-dd4e2567f1d8 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-37dfd053-a43a-4751-9b58-9fd0d11d3f95" returned: 0 in 0.806s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-86cb5425-7687-4a75-a627-dd4e2567f1d8 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-37dfd053-a43a-4751-9b58-9fd0d11d3f95 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:54 devstack sudo[88612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-37dfd053-a43a-4751-9b58-9fd0d11d3f95 Apr 28 19:17:54 devstack sudo[88612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:54 devstack sudo[88608]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2015bff2-2671-447f-bcf9-aa65048e659f tempest-VolumesTransfersV355Test-257731320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fc302b40-bf34-4dc0-8148-4ee457a21569" returned: 0 in 0.660s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:54 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2015bff2-2671-447f-bcf9-aa65048e659f tempest-VolumesTransfersV355Test-257731320 None] Lock "cinder-quobyte-fc302b40-bf34-4dc0-8148-4ee457a21569" released by "delete_volume" :: held 1.684s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:17:54 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-2015bff2-2671-447f-bcf9-aa65048e659f tempest-VolumesTransfersV355Test-257731320 None] Created reservations ['8cf91288-4b82-4fff-b434-972edc71eb65', '14be59b8-f75d-492e-8c5b-e9d40d24907d', 'cdc62174-94a7-4afd-bade-fc6a1ddccba4', 'bd6c04b1-1721-4907-904e-77627f0f4d45'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:17:55 devstack sudo[88612]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-86cb5425-7687-4a75-a627-dd4e2567f1d8 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-37dfd053-a43a-4751-9b58-9fd0d11d3f95" returned: 0 in 0.653s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:55 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-86cb5425-7687-4a75-a627-dd4e2567f1d8 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "cinder-quobyte-37dfd053-a43a-4751-9b58-9fd0d11d3f95" released by "delete_volume" :: held 1.513s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:17:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2015bff2-2671-447f-bcf9-aa65048e659f tempest-VolumesTransfersV355Test-257731320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:17:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2015bff2-2671-447f-bcf9-aa65048e659f tempest-VolumesTransfersV355Test-257731320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:17:55 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2015bff2-2671-447f-bcf9-aa65048e659f tempest-VolumesTransfersV355Test-257731320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:17:55 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2015bff2-2671-447f-bcf9-aa65048e659f tempest-VolumesTransfersV355Test-257731320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:17:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2015bff2-2671-447f-bcf9-aa65048e659f tempest-VolumesTransfersV355Test-257731320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:17:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2015bff2-2671-447f-bcf9-aa65048e659f tempest-VolumesTransfersV355Test-257731320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:55 devstack sudo[88620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:17:55 devstack sudo[88620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:55 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-86cb5425-7687-4a75-a627-dd4e2567f1d8 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Created reservations ['83a8d54c-a23c-47a3-b780-c52f6d404925', '3d63e35f-5b9a-4ff8-8b0f-2555cee18469', '1e818de0-7cf2-4b0a-9dee-6592ed3d4547', '51cc8dea-777b-43db-ba83-6470cf21bc7d'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:17:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-86cb5425-7687-4a75-a627-dd4e2567f1d8 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:17:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-86cb5425-7687-4a75-a627-dd4e2567f1d8 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:17:55 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-86cb5425-7687-4a75-a627-dd4e2567f1d8 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:17:55 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-86cb5425-7687-4a75-a627-dd4e2567f1d8 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:17:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-86cb5425-7687-4a75-a627-dd4e2567f1d8 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:17:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-86cb5425-7687-4a75-a627-dd4e2567f1d8 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:55 devstack sudo[88622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:17:55 devstack sudo[88622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:55 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-048e92bd-859f-41a6-88f1-1ffd8b0cab2c tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Acquiring lock "cinder-55ca4688-fd7b-4ef3-a3b3-d90fbd825171-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:17:55 devstack sudo[88620]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2015bff2-2671-447f-bcf9-aa65048e659f tempest-VolumesTransfersV355Test-257731320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.675s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:55 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-2015bff2-2671-447f-bcf9-aa65048e659f tempest-VolumesTransfersV355Test-257731320 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:17:55 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-048e92bd-859f-41a6-88f1-1ffd8b0cab2c tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "cinder-55ca4688-fd7b-4ef3-a3b3-d90fbd825171-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:17:55 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-2015bff2-2671-447f-bcf9-aa65048e659f tempest-VolumesTransfersV355Test-257731320 None] Deleted volume successfully. Apr 28 19:17:55 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2015bff2-2671-447f-bcf9-aa65048e659f tempest-VolumesTransfersV355Test-257731320 None] Lock "cinder-fc302b40-bf34-4dc0-8148-4ee457a21569-delete_volume" released by "delete_volume" :: held 2.663s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:17:55 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-048e92bd-859f-41a6-88f1-1ffd8b0cab2c tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Acquiring lock "cinder-quobyte-55ca4688-fd7b-4ef3-a3b3-d90fbd825171" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:17:55 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-048e92bd-859f-41a6-88f1-1ffd8b0cab2c tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "cinder-quobyte-55ca4688-fd7b-4ef3-a3b3-d90fbd825171" acquired by "delete_volume" :: waited 0.031s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:17:55 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[193e4b99-4c31-4b62-95c3-3ac904ae6ad8]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:17:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-048e92bd-859f-41a6-88f1-1ffd8b0cab2c tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55ca4688-fd7b-4ef3-a3b3-d90fbd825171 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:55 devstack sudo[88622]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:55 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-e40f2fd2-4d18-48a1-960f-c321259f7bcc tempest-VolumesTransfersV355Test-975964247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:17:55 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e40f2fd2-4d18-48a1-960f-c321259f7bcc tempest-VolumesTransfersV355Test-975964247 None] Flow 'volume_create_manager' (f0e68b9e-9360-4a29-8d43-06ffee34faa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:17:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e40f2fd2-4d18-48a1-960f-c321259f7bcc tempest-VolumesTransfersV355Test-975964247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e00d68e-bc5a-4055-ad56-848dfdbfe7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-86cb5425-7687-4a75-a627-dd4e2567f1d8 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.840s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:56 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-86cb5425-7687-4a75-a627-dd4e2567f1d8 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:17:56 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-86cb5425-7687-4a75-a627-dd4e2567f1d8 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Deleted volume successfully. Apr 28 19:17:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e40f2fd2-4d18-48a1-960f-c321259f7bcc tempest-VolumesTransfersV355Test-975964247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e00d68e-bc5a-4055-ad56-848dfdbfe7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1207794356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5423f9c5-5263-4b20-a0a5-0bed7a4a3ba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f386c88d70a84949b9c898a41a099e86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:17:56Z,use_quota=True,user_id='68bd054afa9d477d95fae1f5e34ee7fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e40f2fd2-4d18-48a1-960f-c321259f7bcc tempest-VolumesTransfersV355Test-975964247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (785d95bb-ce39-4bc8-926e-61db5647d8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e40f2fd2-4d18-48a1-960f-c321259f7bcc tempest-VolumesTransfersV355Test-975964247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (785d95bb-ce39-4bc8-926e-61db5647d8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e40f2fd2-4d18-48a1-960f-c321259f7bcc tempest-VolumesTransfersV355Test-975964247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27af0552-502f-48c3-9434-872e0df4c887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:56 devstack sudo[88626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55ca4688-fd7b-4ef3-a3b3-d90fbd825171 Apr 28 19:17:56 devstack sudo[88626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e40f2fd2-4d18-48a1-960f-c321259f7bcc tempest-VolumesTransfersV355Test-975964247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27af0552-502f-48c3-9434-872e0df4c887) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5423f9c5-5263-4b20-a0a5-0bed7a4a3ba9', 'volume_name': 'volume-5423f9c5-5263-4b20-a0a5-0bed7a4a3ba9', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e40f2fd2-4d18-48a1-960f-c321259f7bcc tempest-VolumesTransfersV355Test-975964247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e1f8064-a2b6-47d3-84eb-d0af20d49f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e40f2fd2-4d18-48a1-960f-c321259f7bcc tempest-VolumesTransfersV355Test-975964247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e1f8064-a2b6-47d3-84eb-d0af20d49f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e40f2fd2-4d18-48a1-960f-c321259f7bcc tempest-VolumesTransfersV355Test-975964247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3423273-0d98-413f-aa77-b943387f658e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:56 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-e40f2fd2-4d18-48a1-960f-c321259f7bcc tempest-VolumesTransfersV355Test-975964247 None] Volume 5423f9c5-5263-4b20-a0a5-0bed7a4a3ba9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5423f9c5-5263-4b20-a0a5-0bed7a4a3ba9', 'volume_size': 1} Apr 28 19:17:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e40f2fd2-4d18-48a1-960f-c321259f7bcc tempest-VolumesTransfersV355Test-975964247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:17:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e40f2fd2-4d18-48a1-960f-c321259f7bcc tempest-VolumesTransfersV355Test-975964247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:17:56 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-e40f2fd2-4d18-48a1-960f-c321259f7bcc tempest-VolumesTransfersV355Test-975964247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1207794356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5423f9c5-5263-4b20-a0a5-0bed7a4a3ba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f386c88d70a84949b9c898a41a099e86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:17:56Z,use_quota=True,user_id='68bd054afa9d477d95fae1f5e34ee7fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:17:56 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-e40f2fd2-4d18-48a1-960f-c321259f7bcc tempest-VolumesTransfersV355Test-975964247 None] Creating volume 5423f9c5-5263-4b20-a0a5-0bed7a4a3ba9 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:17:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e40f2fd2-4d18-48a1-960f-c321259f7bcc tempest-VolumesTransfersV355Test-975964247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:17:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e40f2fd2-4d18-48a1-960f-c321259f7bcc tempest-VolumesTransfersV355Test-975964247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:17:56 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-e40f2fd2-4d18-48a1-960f-c321259f7bcc tempest-VolumesTransfersV355Test-975964247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:17:56 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-e40f2fd2-4d18-48a1-960f-c321259f7bcc tempest-VolumesTransfersV355Test-975964247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:17:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e40f2fd2-4d18-48a1-960f-c321259f7bcc tempest-VolumesTransfersV355Test-975964247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:17:56 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-e40f2fd2-4d18-48a1-960f-c321259f7bcc tempest-VolumesTransfersV355Test-975964247 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:17:56 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-e40f2fd2-4d18-48a1-960f-c321259f7bcc tempest-VolumesTransfersV355Test-975964247 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:17:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e40f2fd2-4d18-48a1-960f-c321259f7bcc tempest-VolumesTransfersV355Test-975964247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5423f9c5-5263-4b20-a0a5-0bed7a4a3ba9 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:56 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-86cb5425-7687-4a75-a627-dd4e2567f1d8 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "cinder-37dfd053-a43a-4751-9b58-9fd0d11d3f95-delete_volume" released by "delete_volume" :: held 2.797s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:17:56 devstack sudo[88644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5423f9c5-5263-4b20-a0a5-0bed7a4a3ba9 1073741824 Apr 28 19:17:56 devstack sudo[88644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:57 devstack sudo[88626]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-048e92bd-859f-41a6-88f1-1ffd8b0cab2c tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55ca4688-fd7b-4ef3-a3b3-d90fbd825171" returned: 0 in 1.286s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-048e92bd-859f-41a6-88f1-1ffd8b0cab2c tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55ca4688-fd7b-4ef3-a3b3-d90fbd825171 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:57 devstack sudo[88674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55ca4688-fd7b-4ef3-a3b3-d90fbd825171 Apr 28 19:17:57 devstack sudo[88674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:57 devstack sudo[88644]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e40f2fd2-4d18-48a1-960f-c321259f7bcc tempest-VolumesTransfersV355Test-975964247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5423f9c5-5263-4b20-a0a5-0bed7a4a3ba9 1073741824" returned: 0 in 1.265s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e40f2fd2-4d18-48a1-960f-c321259f7bcc tempest-VolumesTransfersV355Test-975964247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5423f9c5-5263-4b20-a0a5-0bed7a4a3ba9 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:57 devstack sudo[88677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5423f9c5-5263-4b20-a0a5-0bed7a4a3ba9 Apr 28 19:17:57 devstack sudo[88677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:57 devstack sudo[88674]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-048e92bd-859f-41a6-88f1-1ffd8b0cab2c tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55ca4688-fd7b-4ef3-a3b3-d90fbd825171" returned: 0 in 0.716s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:57 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-048e92bd-859f-41a6-88f1-1ffd8b0cab2c tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "cinder-quobyte-55ca4688-fd7b-4ef3-a3b3-d90fbd825171" released by "delete_volume" :: held 2.080s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:17:57 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-048e92bd-859f-41a6-88f1-1ffd8b0cab2c tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Created reservations ['651a6d0e-25e1-4de4-92a6-bfac9ee7a083', 'c302cfe7-d667-4123-9508-1c3482b4cbc4', '9d28ac8d-ae07-4009-acad-65b4a8b5fdbc', '1240f354-7212-49fc-a650-4f52f5dd4b3d'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:17:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-048e92bd-859f-41a6-88f1-1ffd8b0cab2c tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:17:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-048e92bd-859f-41a6-88f1-1ffd8b0cab2c tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:17:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-048e92bd-859f-41a6-88f1-1ffd8b0cab2c tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:17:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-048e92bd-859f-41a6-88f1-1ffd8b0cab2c tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:17:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-048e92bd-859f-41a6-88f1-1ffd8b0cab2c tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:17:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-048e92bd-859f-41a6-88f1-1ffd8b0cab2c tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:58 devstack sudo[88682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:17:58 devstack sudo[88682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:17:58 devstack sudo[88677]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e40f2fd2-4d18-48a1-960f-c321259f7bcc tempest-VolumesTransfersV355Test-975964247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5423f9c5-5263-4b20-a0a5-0bed7a4a3ba9" returned: 0 in 0.885s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-e40f2fd2-4d18-48a1-960f-c321259f7bcc tempest-VolumesTransfersV355Test-975964247 None] <== create_volume: return (2250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:17:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e40f2fd2-4d18-48a1-960f-c321259f7bcc tempest-VolumesTransfersV355Test-975964247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.255s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:17:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e40f2fd2-4d18-48a1-960f-c321259f7bcc tempest-VolumesTransfersV355Test-975964247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3423273-0d98-413f-aa77-b943387f658e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5423f9c5-5263-4b20-a0a5-0bed7a4a3ba9', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e40f2fd2-4d18-48a1-960f-c321259f7bcc tempest-VolumesTransfersV355Test-975964247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (658433a8-6873-4b1b-8cc8-86d25a0ce9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:17:58 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-e40f2fd2-4d18-48a1-960f-c321259f7bcc tempest-VolumesTransfersV355Test-975964247 None] Volume volume-5423f9c5-5263-4b20-a0a5-0bed7a4a3ba9 (5423f9c5-5263-4b20-a0a5-0bed7a4a3ba9): created successfully Apr 28 19:17:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e40f2fd2-4d18-48a1-960f-c321259f7bcc tempest-VolumesTransfersV355Test-975964247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (658433a8-6873-4b1b-8cc8-86d25a0ce9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:17:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e40f2fd2-4d18-48a1-960f-c321259f7bcc tempest-VolumesTransfersV355Test-975964247 None] Flow 'volume_create_manager' (f0e68b9e-9360-4a29-8d43-06ffee34faa3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:17:58 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-e40f2fd2-4d18-48a1-960f-c321259f7bcc tempest-VolumesTransfersV355Test-975964247 None] Created volume successfully. Apr 28 19:17:58 devstack sudo[88682]: pam_unix(sudo:session): session closed for user root Apr 28 19:17:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-048e92bd-859f-41a6-88f1-1ffd8b0cab2c tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.817s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:17:58 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-048e92bd-859f-41a6-88f1-1ffd8b0cab2c tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:17:58 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-048e92bd-859f-41a6-88f1-1ffd8b0cab2c tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Deleted volume successfully. Apr 28 19:17:58 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-048e92bd-859f-41a6-88f1-1ffd8b0cab2c tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "cinder-55ca4688-fd7b-4ef3-a3b3-d90fbd825171-delete_volume" released by "delete_volume" :: held 3.274s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:17:59 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-981a3ac2-d7d4-446e-8417-ed8f6f5e1e32 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Acquiring lock "cinder-7c9ca9f3-3624-4528-9805-619e04833871-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:17:59 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-981a3ac2-d7d4-446e-8417-ed8f6f5e1e32 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "cinder-7c9ca9f3-3624-4528-9805-619e04833871-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:17:59 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-981a3ac2-d7d4-446e-8417-ed8f6f5e1e32 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Acquiring lock "cinder-quobyte-7c9ca9f3-3624-4528-9805-619e04833871" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:17:59 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-981a3ac2-d7d4-446e-8417-ed8f6f5e1e32 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "cinder-quobyte-7c9ca9f3-3624-4528-9805-619e04833871" acquired by "delete_volume" :: waited 0.032s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:17:59 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[75582981-804c-445f-a86a-5a75f32df0aa]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:17:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-981a3ac2-d7d4-446e-8417-ed8f6f5e1e32 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7c9ca9f3-3624-4528-9805-619e04833871 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:17:59 devstack sudo[88687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7c9ca9f3-3624-4528-9805-619e04833871 Apr 28 19:17:59 devstack sudo[88687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:18:00 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a1703c22-7c43-422a-a056-ce40f80bdf21 tempest-VolumesTransfersV355Test-257731320 None] Acquiring lock "cinder-5423f9c5-5263-4b20-a0a5-0bed7a4a3ba9-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:18:00 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a1703c22-7c43-422a-a056-ce40f80bdf21 tempest-VolumesTransfersV355Test-257731320 None] Lock "cinder-5423f9c5-5263-4b20-a0a5-0bed7a4a3ba9-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:18:00 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a1703c22-7c43-422a-a056-ce40f80bdf21 tempest-VolumesTransfersV355Test-257731320 None] Acquiring lock "cinder-quobyte-5423f9c5-5263-4b20-a0a5-0bed7a4a3ba9" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:18:00 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a1703c22-7c43-422a-a056-ce40f80bdf21 tempest-VolumesTransfersV355Test-257731320 None] Lock "cinder-quobyte-5423f9c5-5263-4b20-a0a5-0bed7a4a3ba9" acquired by "delete_volume" :: waited 0.062s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:18:00 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f47864-7852-4994-92d1-afd5d779a461]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:18:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a1703c22-7c43-422a-a056-ce40f80bdf21 tempest-VolumesTransfersV355Test-257731320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5423f9c5-5263-4b20-a0a5-0bed7a4a3ba9 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:18:00 devstack sudo[88689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5423f9c5-5263-4b20-a0a5-0bed7a4a3ba9 Apr 28 19:18:00 devstack sudo[88689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:18:01 devstack sudo[88687]: pam_unix(sudo:session): session closed for user root Apr 28 19:18:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-981a3ac2-d7d4-446e-8417-ed8f6f5e1e32 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7c9ca9f3-3624-4528-9805-619e04833871" returned: 0 in 1.481s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:18:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-981a3ac2-d7d4-446e-8417-ed8f6f5e1e32 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7c9ca9f3-3624-4528-9805-619e04833871 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:18:01 devstack sudo[88695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7c9ca9f3-3624-4528-9805-619e04833871 Apr 28 19:18:01 devstack sudo[88695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:18:01 devstack sudo[88689]: pam_unix(sudo:session): session closed for user root Apr 28 19:18:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a1703c22-7c43-422a-a056-ce40f80bdf21 tempest-VolumesTransfersV355Test-257731320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5423f9c5-5263-4b20-a0a5-0bed7a4a3ba9" returned: 0 in 1.190s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:18:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a1703c22-7c43-422a-a056-ce40f80bdf21 tempest-VolumesTransfersV355Test-257731320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5423f9c5-5263-4b20-a0a5-0bed7a4a3ba9 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:18:01 devstack sudo[88701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5423f9c5-5263-4b20-a0a5-0bed7a4a3ba9 Apr 28 19:18:01 devstack sudo[88701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:18:01 devstack sudo[88695]: pam_unix(sudo:session): session closed for user root Apr 28 19:18:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-981a3ac2-d7d4-446e-8417-ed8f6f5e1e32 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7c9ca9f3-3624-4528-9805-619e04833871" returned: 0 in 0.900s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:18:01 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-981a3ac2-d7d4-446e-8417-ed8f6f5e1e32 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "cinder-quobyte-7c9ca9f3-3624-4528-9805-619e04833871" released by "delete_volume" :: held 2.474s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:18:02 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-981a3ac2-d7d4-446e-8417-ed8f6f5e1e32 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Created reservations ['73bb3f78-85e8-4728-9894-6da64edc113a', '83b91443-a3b8-43e8-af97-28238d6b2079', 'c450a1ee-7570-403f-9c2c-ee4cd7ff7e62', '98918c8c-33d5-46eb-9d20-6b4de060a75a'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:18:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-981a3ac2-d7d4-446e-8417-ed8f6f5e1e32 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:18:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-981a3ac2-d7d4-446e-8417-ed8f6f5e1e32 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:18:02 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-981a3ac2-d7d4-446e-8417-ed8f6f5e1e32 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:18:02 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-981a3ac2-d7d4-446e-8417-ed8f6f5e1e32 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:18:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-981a3ac2-d7d4-446e-8417-ed8f6f5e1e32 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:18:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-981a3ac2-d7d4-446e-8417-ed8f6f5e1e32 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:18:02 devstack sudo[88704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:18:02 devstack sudo[88704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:18:02 devstack sudo[88701]: pam_unix(sudo:session): session closed for user root Apr 28 19:18:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a1703c22-7c43-422a-a056-ce40f80bdf21 tempest-VolumesTransfersV355Test-257731320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5423f9c5-5263-4b20-a0a5-0bed7a4a3ba9" returned: 0 in 0.923s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:18:02 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a1703c22-7c43-422a-a056-ce40f80bdf21 tempest-VolumesTransfersV355Test-257731320 None] Lock "cinder-quobyte-5423f9c5-5263-4b20-a0a5-0bed7a4a3ba9" released by "delete_volume" :: held 2.187s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:18:02 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-a1703c22-7c43-422a-a056-ce40f80bdf21 tempest-VolumesTransfersV355Test-257731320 None] Created reservations ['c3aceb4e-3aeb-4d08-89c2-836023dac0df', '58fc6546-7264-49d2-b7db-9846f4a8c25c', 'd6e9d94b-6e2c-425b-88a4-2eb895ad3783', 'd9e1d4d4-66b0-4f5f-8171-81d91cf6d57a'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:18:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a1703c22-7c43-422a-a056-ce40f80bdf21 tempest-VolumesTransfersV355Test-257731320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:18:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a1703c22-7c43-422a-a056-ce40f80bdf21 tempest-VolumesTransfersV355Test-257731320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:18:02 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a1703c22-7c43-422a-a056-ce40f80bdf21 tempest-VolumesTransfersV355Test-257731320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:18:02 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a1703c22-7c43-422a-a056-ce40f80bdf21 tempest-VolumesTransfersV355Test-257731320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:18:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a1703c22-7c43-422a-a056-ce40f80bdf21 tempest-VolumesTransfersV355Test-257731320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:18:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a1703c22-7c43-422a-a056-ce40f80bdf21 tempest-VolumesTransfersV355Test-257731320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:18:02 devstack sudo[88707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:18:02 devstack sudo[88707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:18:02 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-1915828f-ea04-42c7-b3c5-9046f8b45ede tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Acquiring lock "cinder-9b7b35bd-5aeb-463a-95a3-20d5480a68ae-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:18:02 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-1915828f-ea04-42c7-b3c5-9046f8b45ede tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "cinder-9b7b35bd-5aeb-463a-95a3-20d5480a68ae-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:18:02 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-1915828f-ea04-42c7-b3c5-9046f8b45ede tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Acquiring lock "cinder-quobyte-9b7b35bd-5aeb-463a-95a3-20d5480a68ae" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:18:02 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-1915828f-ea04-42c7-b3c5-9046f8b45ede tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "cinder-quobyte-9b7b35bd-5aeb-463a-95a3-20d5480a68ae" acquired by "delete_volume" :: waited 0.038s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:18:02 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[868d235d-642d-42c9-9bfe-43e6ceaa16e5]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:18:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1915828f-ea04-42c7-b3c5-9046f8b45ede tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9b7b35bd-5aeb-463a-95a3-20d5480a68ae {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:18:03 devstack sudo[88704]: pam_unix(sudo:session): session closed for user root Apr 28 19:18:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-981a3ac2-d7d4-446e-8417-ed8f6f5e1e32 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.996s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:18:03 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-981a3ac2-d7d4-446e-8417-ed8f6f5e1e32 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:18:03 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-981a3ac2-d7d4-446e-8417-ed8f6f5e1e32 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Deleted volume successfully. Apr 28 19:18:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-981a3ac2-d7d4-446e-8417-ed8f6f5e1e32 tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "cinder-7c9ca9f3-3624-4528-9805-619e04833871-delete_volume" released by "delete_volume" :: held 3.830s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:18:03 devstack sudo[88710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9b7b35bd-5aeb-463a-95a3-20d5480a68ae Apr 28 19:18:03 devstack sudo[88710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:18:03 devstack cinder-volume[83863]: DEBUG oslo_service.periodic_task [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 28 19:18:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:18:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:18:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:18:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:18:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:18:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:18:03 devstack sudo[88713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:18:03 devstack sudo[88713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:18:03 devstack sudo[88707]: pam_unix(sudo:session): session closed for user root Apr 28 19:18:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a1703c22-7c43-422a-a056-ce40f80bdf21 tempest-VolumesTransfersV355Test-257731320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.945s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:18:03 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-a1703c22-7c43-422a-a056-ce40f80bdf21 tempest-VolumesTransfersV355Test-257731320 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:18:03 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-a1703c22-7c43-422a-a056-ce40f80bdf21 tempest-VolumesTransfersV355Test-257731320 None] Deleted volume successfully. Apr 28 19:18:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a1703c22-7c43-422a-a056-ce40f80bdf21 tempest-VolumesTransfersV355Test-257731320 None] Lock "cinder-5423f9c5-5263-4b20-a0a5-0bed7a4a3ba9-delete_volume" released by "delete_volume" :: held 3.541s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:18:04 devstack sudo[88713]: pam_unix(sudo:session): session closed for user root Apr 28 19:18:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.958s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:18:04 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:18:04 devstack sudo[88710]: pam_unix(sudo:session): session closed for user root Apr 28 19:18:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1915828f-ea04-42c7-b3c5-9046f8b45ede tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9b7b35bd-5aeb-463a-95a3-20d5480a68ae" returned: 0 in 1.508s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:18:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1915828f-ea04-42c7-b3c5-9046f8b45ede tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9b7b35bd-5aeb-463a-95a3-20d5480a68ae {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:18:04 devstack sudo[88720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9b7b35bd-5aeb-463a-95a3-20d5480a68ae Apr 28 19:18:04 devstack sudo[88720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:18:05 devstack sudo[88720]: pam_unix(sudo:session): session closed for user root Apr 28 19:18:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1915828f-ea04-42c7-b3c5-9046f8b45ede tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9b7b35bd-5aeb-463a-95a3-20d5480a68ae" returned: 0 in 1.109s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:18:05 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-1915828f-ea04-42c7-b3c5-9046f8b45ede tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "cinder-quobyte-9b7b35bd-5aeb-463a-95a3-20d5480a68ae" released by "delete_volume" :: held 2.701s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:18:05 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-1915828f-ea04-42c7-b3c5-9046f8b45ede tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Created reservations ['5bd3335d-3ca4-4888-b3c3-86b7433333b3', '0b74f069-abb7-4c34-96ec-c0fb178b74b7', '357030ac-c922-477f-9a99-46ad4237aa5e', '927ed709-18e7-4ca6-80eb-a66cc95da978'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:18:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1915828f-ea04-42c7-b3c5-9046f8b45ede tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:18:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1915828f-ea04-42c7-b3c5-9046f8b45ede tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:18:05 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1915828f-ea04-42c7-b3c5-9046f8b45ede tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:18:05 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1915828f-ea04-42c7-b3c5-9046f8b45ede tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:18:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1915828f-ea04-42c7-b3c5-9046f8b45ede tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:18:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1915828f-ea04-42c7-b3c5-9046f8b45ede tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:18:05 devstack sudo[88749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:18:05 devstack sudo[88749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:18:07 devstack sudo[88749]: pam_unix(sudo:session): session closed for user root Apr 28 19:18:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1915828f-ea04-42c7-b3c5-9046f8b45ede tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 1.251s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:18:07 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-1915828f-ea04-42c7-b3c5-9046f8b45ede tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:18:07 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-1915828f-ea04-42c7-b3c5-9046f8b45ede tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Deleted volume successfully. Apr 28 19:18:07 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-1915828f-ea04-42c7-b3c5-9046f8b45ede tempest-CreateVolumesFromSourceVolumeTest-1967615727 None] Lock "cinder-9b7b35bd-5aeb-463a-95a3-20d5480a68ae-delete_volume" released by "delete_volume" :: held 4.321s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:18:14 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-39a9522b-38f9-4324-93d7-b6f0daadcf71 tempest-VolumeTypesAccessTest-1398880284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:18:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-39a9522b-38f9-4324-93d7-b6f0daadcf71 tempest-VolumeTypesAccessTest-1398880284 None] Flow 'volume_create_manager' (f598d59c-3bd8-4d99-9923-d002b749bb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:18:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-39a9522b-38f9-4324-93d7-b6f0daadcf71 tempest-VolumeTypesAccessTest-1398880284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fbd5ba1-9018-45f6-9566-b11dce1f59e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:18:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-39a9522b-38f9-4324-93d7-b6f0daadcf71 tempest-VolumeTypesAccessTest-1398880284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fbd5ba1-9018-45f6-9566-b11dce1f59e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-999569180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acda22fc-ff7f-42d6-a234-6a52c1747166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64276e60830c470f9383aceb1c234ca7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:18:15Z,use_quota=True,user_id='50c8218b3d0545518291ee44997f6919',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d9adce5-03b7-40b1-91fb-b38a11114f19),volume_type_id=8d9adce5-03b7-40b1-91fb-b38a11114f19)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:18:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-39a9522b-38f9-4324-93d7-b6f0daadcf71 tempest-VolumeTypesAccessTest-1398880284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db840f88-885f-45de-ab2d-a64bbc824c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:18:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-39a9522b-38f9-4324-93d7-b6f0daadcf71 tempest-VolumeTypesAccessTest-1398880284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db840f88-885f-45de-ab2d-a64bbc824c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:18:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-39a9522b-38f9-4324-93d7-b6f0daadcf71 tempest-VolumeTypesAccessTest-1398880284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fccc913-4732-4ad6-8e83-0a2a2019640d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:18:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-39a9522b-38f9-4324-93d7-b6f0daadcf71 tempest-VolumeTypesAccessTest-1398880284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fccc913-4732-4ad6-8e83-0a2a2019640d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acda22fc-ff7f-42d6-a234-6a52c1747166', 'volume_name': 'volume-acda22fc-ff7f-42d6-a234-6a52c1747166', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:18:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-39a9522b-38f9-4324-93d7-b6f0daadcf71 tempest-VolumeTypesAccessTest-1398880284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c5ea3a-1ef9-4f6a-94af-d2e0f6400dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:18:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-39a9522b-38f9-4324-93d7-b6f0daadcf71 tempest-VolumeTypesAccessTest-1398880284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c5ea3a-1ef9-4f6a-94af-d2e0f6400dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:18:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-39a9522b-38f9-4324-93d7-b6f0daadcf71 tempest-VolumeTypesAccessTest-1398880284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e20737a-99ee-4e25-a0a3-84d0a8bae5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:18:14 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-39a9522b-38f9-4324-93d7-b6f0daadcf71 tempest-VolumeTypesAccessTest-1398880284 None] Volume acda22fc-ff7f-42d6-a234-6a52c1747166: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acda22fc-ff7f-42d6-a234-6a52c1747166', 'volume_size': 1} Apr 28 19:18:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-39a9522b-38f9-4324-93d7-b6f0daadcf71 tempest-VolumeTypesAccessTest-1398880284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:18:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-39a9522b-38f9-4324-93d7-b6f0daadcf71 tempest-VolumeTypesAccessTest-1398880284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:18:14 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-39a9522b-38f9-4324-93d7-b6f0daadcf71 tempest-VolumeTypesAccessTest-1398880284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-999569180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acda22fc-ff7f-42d6-a234-6a52c1747166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64276e60830c470f9383aceb1c234ca7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:18:15Z,use_quota=True,user_id='50c8218b3d0545518291ee44997f6919',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d9adce5-03b7-40b1-91fb-b38a11114f19),volume_type_id=8d9adce5-03b7-40b1-91fb-b38a11114f19)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:18:14 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-39a9522b-38f9-4324-93d7-b6f0daadcf71 tempest-VolumeTypesAccessTest-1398880284 None] Creating volume acda22fc-ff7f-42d6-a234-6a52c1747166 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:18:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-39a9522b-38f9-4324-93d7-b6f0daadcf71 tempest-VolumeTypesAccessTest-1398880284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:18:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-39a9522b-38f9-4324-93d7-b6f0daadcf71 tempest-VolumeTypesAccessTest-1398880284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:18:14 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-39a9522b-38f9-4324-93d7-b6f0daadcf71 tempest-VolumeTypesAccessTest-1398880284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:18:14 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-39a9522b-38f9-4324-93d7-b6f0daadcf71 tempest-VolumeTypesAccessTest-1398880284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:18:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-39a9522b-38f9-4324-93d7-b6f0daadcf71 tempest-VolumeTypesAccessTest-1398880284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:18:14 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-39a9522b-38f9-4324-93d7-b6f0daadcf71 tempest-VolumeTypesAccessTest-1398880284 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:18:14 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-39a9522b-38f9-4324-93d7-b6f0daadcf71 tempest-VolumeTypesAccessTest-1398880284 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:18:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-39a9522b-38f9-4324-93d7-b6f0daadcf71 tempest-VolumeTypesAccessTest-1398880284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-acda22fc-ff7f-42d6-a234-6a52c1747166 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:18:14 devstack sudo[88796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-acda22fc-ff7f-42d6-a234-6a52c1747166 1073741824 Apr 28 19:18:14 devstack sudo[88796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:18:15 devstack sudo[88796]: pam_unix(sudo:session): session closed for user root Apr 28 19:18:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-39a9522b-38f9-4324-93d7-b6f0daadcf71 tempest-VolumeTypesAccessTest-1398880284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-acda22fc-ff7f-42d6-a234-6a52c1747166 1073741824" returned: 0 in 0.878s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:18:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-39a9522b-38f9-4324-93d7-b6f0daadcf71 tempest-VolumeTypesAccessTest-1398880284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-acda22fc-ff7f-42d6-a234-6a52c1747166 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:18:15 devstack sudo[88802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-acda22fc-ff7f-42d6-a234-6a52c1747166 Apr 28 19:18:15 devstack sudo[88802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:18:16 devstack sudo[88802]: pam_unix(sudo:session): session closed for user root Apr 28 19:18:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-39a9522b-38f9-4324-93d7-b6f0daadcf71 tempest-VolumeTypesAccessTest-1398880284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-acda22fc-ff7f-42d6-a234-6a52c1747166" returned: 0 in 0.692s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:18:16 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-39a9522b-38f9-4324-93d7-b6f0daadcf71 tempest-VolumeTypesAccessTest-1398880284 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:18:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-39a9522b-38f9-4324-93d7-b6f0daadcf71 tempest-VolumeTypesAccessTest-1398880284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:18:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-39a9522b-38f9-4324-93d7-b6f0daadcf71 tempest-VolumeTypesAccessTest-1398880284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e20737a-99ee-4e25-a0a3-84d0a8bae5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acda22fc-ff7f-42d6-a234-6a52c1747166', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:18:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-39a9522b-38f9-4324-93d7-b6f0daadcf71 tempest-VolumeTypesAccessTest-1398880284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4da58524-a10d-467d-9c09-97f9ad4545bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:18:16 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-39a9522b-38f9-4324-93d7-b6f0daadcf71 tempest-VolumeTypesAccessTest-1398880284 None] Volume volume-acda22fc-ff7f-42d6-a234-6a52c1747166 (acda22fc-ff7f-42d6-a234-6a52c1747166): created successfully Apr 28 19:18:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-39a9522b-38f9-4324-93d7-b6f0daadcf71 tempest-VolumeTypesAccessTest-1398880284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4da58524-a10d-467d-9c09-97f9ad4545bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:18:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-39a9522b-38f9-4324-93d7-b6f0daadcf71 tempest-VolumeTypesAccessTest-1398880284 None] Flow 'volume_create_manager' (f598d59c-3bd8-4d99-9923-d002b749bb81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:18:16 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-39a9522b-38f9-4324-93d7-b6f0daadcf71 tempest-VolumeTypesAccessTest-1398880284 None] Created volume successfully. Apr 28 19:18:17 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d51b2686-c36b-4aa7-8c99-ba375f15288c tempest-VolumeTypesAccessTest-1398880284 None] Acquiring lock "cinder-acda22fc-ff7f-42d6-a234-6a52c1747166-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:18:17 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d51b2686-c36b-4aa7-8c99-ba375f15288c tempest-VolumeTypesAccessTest-1398880284 None] Lock "cinder-acda22fc-ff7f-42d6-a234-6a52c1747166-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:18:17 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d51b2686-c36b-4aa7-8c99-ba375f15288c tempest-VolumeTypesAccessTest-1398880284 None] Acquiring lock "cinder-quobyte-acda22fc-ff7f-42d6-a234-6a52c1747166" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:18:17 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d51b2686-c36b-4aa7-8c99-ba375f15288c tempest-VolumeTypesAccessTest-1398880284 None] Lock "cinder-quobyte-acda22fc-ff7f-42d6-a234-6a52c1747166" acquired by "delete_volume" :: waited 0.020s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:18:17 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[919865e8-3b13-4925-a707-96ccc6ead3eb]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:18:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d51b2686-c36b-4aa7-8c99-ba375f15288c tempest-VolumeTypesAccessTest-1398880284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-acda22fc-ff7f-42d6-a234-6a52c1747166 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:18:17 devstack sudo[88805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-acda22fc-ff7f-42d6-a234-6a52c1747166 Apr 28 19:18:17 devstack sudo[88805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:18:17 devstack sudo[88805]: pam_unix(sudo:session): session closed for user root Apr 28 19:18:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d51b2686-c36b-4aa7-8c99-ba375f15288c tempest-VolumeTypesAccessTest-1398880284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-acda22fc-ff7f-42d6-a234-6a52c1747166" returned: 0 in 0.720s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:18:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d51b2686-c36b-4aa7-8c99-ba375f15288c tempest-VolumeTypesAccessTest-1398880284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-acda22fc-ff7f-42d6-a234-6a52c1747166 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:18:17 devstack sudo[88811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-acda22fc-ff7f-42d6-a234-6a52c1747166 Apr 28 19:18:17 devstack sudo[88811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:18:18 devstack sudo[88811]: pam_unix(sudo:session): session closed for user root Apr 28 19:18:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d51b2686-c36b-4aa7-8c99-ba375f15288c tempest-VolumeTypesAccessTest-1398880284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-acda22fc-ff7f-42d6-a234-6a52c1747166" returned: 0 in 0.705s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:18:18 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d51b2686-c36b-4aa7-8c99-ba375f15288c tempest-VolumeTypesAccessTest-1398880284 None] Lock "cinder-quobyte-acda22fc-ff7f-42d6-a234-6a52c1747166" released by "delete_volume" :: held 1.478s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:18:18 devstack cinder-volume[83863]: WARNING cinder.quota [None req-d51b2686-c36b-4aa7-8c99-ba375f15288c tempest-VolumeTypesAccessTest-1398880284 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2042816360 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2042816360, it is now deprecated. Please use the default quota class for default quota. Apr 28 19:18:18 devstack cinder-volume[83863]: WARNING cinder.quota [None req-d51b2686-c36b-4aa7-8c99-ba375f15288c tempest-VolumeTypesAccessTest-1398880284 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2042816360 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2042816360, it is now deprecated. Please use the default quota class for default quota. Apr 28 19:18:18 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-d51b2686-c36b-4aa7-8c99-ba375f15288c tempest-VolumeTypesAccessTest-1398880284 None] Created reservations ['11249dec-9531-4590-9022-b51f9e47625b', '1a95dd7f-9d28-41e8-9288-c8a814ea3fb1', '968bffaa-ea18-4b3e-adaa-2c323a2bde62', '5720b565-f3be-4c51-b00c-522e431e9625'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:18:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d51b2686-c36b-4aa7-8c99-ba375f15288c tempest-VolumeTypesAccessTest-1398880284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:18:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d51b2686-c36b-4aa7-8c99-ba375f15288c tempest-VolumeTypesAccessTest-1398880284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:18:18 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d51b2686-c36b-4aa7-8c99-ba375f15288c tempest-VolumeTypesAccessTest-1398880284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:18:18 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d51b2686-c36b-4aa7-8c99-ba375f15288c tempest-VolumeTypesAccessTest-1398880284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:18:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d51b2686-c36b-4aa7-8c99-ba375f15288c tempest-VolumeTypesAccessTest-1398880284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:18:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d51b2686-c36b-4aa7-8c99-ba375f15288c tempest-VolumeTypesAccessTest-1398880284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:18:18 devstack sudo[88814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:18:18 devstack sudo[88814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:18:19 devstack sudo[88814]: pam_unix(sudo:session): session closed for user root Apr 28 19:18:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d51b2686-c36b-4aa7-8c99-ba375f15288c tempest-VolumeTypesAccessTest-1398880284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 1.191s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:18:20 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-d51b2686-c36b-4aa7-8c99-ba375f15288c tempest-VolumeTypesAccessTest-1398880284 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:18:20 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-d51b2686-c36b-4aa7-8c99-ba375f15288c tempest-VolumeTypesAccessTest-1398880284 None] Deleted volume successfully. Apr 28 19:18:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d51b2686-c36b-4aa7-8c99-ba375f15288c tempest-VolumeTypesAccessTest-1398880284 None] Lock "cinder-acda22fc-ff7f-42d6-a234-6a52c1747166-delete_volume" released by "delete_volume" :: held 3.000s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:18:21 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:18:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Flow 'volume_create_manager' (2fa4af65-3291-41c8-b1eb-c8457b25fb59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:18:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91252e23-e982-4ad6-84a0-b08fbe10cbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:18:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91252e23-e982-4ad6-84a0-b08fbe10cbd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:18:21Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a95647a3-ad00-47a8-b570-c2b77f5eaed5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc1948fb33ee4623afe433b535ba7283',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:18:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:18:21Z,use_quota=True,user_id='76eae2fdd3344aa28f0bb12673b1cb44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:18:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c2652c7-276b-4e23-bede-721fc5ae2dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:18:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c2652c7-276b-4e23-bede-721fc5ae2dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:18:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e0f3b61-86fa-44c9-8468-2418a02625b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:18:21 devstack cinder-volume[83863]: DEBUG cinder.image.glance [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Creating Keystone auth plugin from conf {{(pid=83863) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 28 19:18:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e0f3b61-86fa-44c9-8468-2418a02625b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a95647a3-ad00-47a8-b570-c2b77f5eaed5', 'volume_name': 'volume-a95647a3-ad00-47a8-b570-c2b77f5eaed5', 'volume_size': 1, 'image_id': 'd11adb91-6b52-452f-a796-9ef8412183bf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d11adb91-6b52-452f-a796-9ef8412183bf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6469daf89505401a8582e1f501a60d80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd11adb91-6b52-452f-a796-9ef8412183bf', 'created_at': datetime.datetime(2026, 4, 28, 17, 9, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 17, 9, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d11adb91-6b52-452f-a796-9ef8412183bf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:18:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ece78960-b783-43af-937a-951aa2079784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:18:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ece78960-b783-43af-937a-951aa2079784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:18:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d2d3fd4-4cdc-4e13-be89-1e01e8c54099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:18:21 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Volume a95647a3-ad00-47a8-b570-c2b77f5eaed5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a95647a3-ad00-47a8-b570-c2b77f5eaed5', 'volume_size': 1, 'image_id': 'd11adb91-6b52-452f-a796-9ef8412183bf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d11adb91-6b52-452f-a796-9ef8412183bf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6469daf89505401a8582e1f501a60d80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd11adb91-6b52-452f-a796-9ef8412183bf', 'created_at': datetime.datetime(2026, 4, 28, 17, 9, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 17, 9, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d11adb91-6b52-452f-a796-9ef8412183bf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 28 19:18:21 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Trying to clone a95647a3-ad00-47a8-b570-c2b77f5eaed5 from image d11adb91-6b52-452f-a796-9ef8412183bf at location (None, [{'url': 'file:///opt/stack/data/glance/images/d11adb91-6b52-452f-a796-9ef8412183bf', 'metadata': {}}]). {{(pid=83863) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Apr 28 19:18:22 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_chyvegtfdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83863) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 28 19:18:22 devstack cinder-volume[83863]: INFO cinder.image.image_utils [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Image download 20.69 MB at 20.69 MB/s Apr 28 19:18:22 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[15066a74-9ca6-4a6e-8ddf-c3f874224705]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:18:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_chyvegtfdevstack@QuobyteHD {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:18:22 devstack sudo[88819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_chyvegtfdevstack@QuobyteHD Apr 28 19:18:22 devstack sudo[88819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:18:23 devstack sudo[88819]: pam_unix(sudo:session): session closed for user root Apr 28 19:18:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_chyvegtfdevstack@QuobyteHD" returned: 0 in 0.798s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:18:23 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Temporary image d11adb91-6b52-452f-a796-9ef8412183bf is fetched for user 76eae2fdd3344aa28f0bb12673b1cb44. {{(pid=83863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 28 19:18:23 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff06ee57-78d8-45ed-93a8-e2b37e652baf]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:18:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_chyvegtfdevstack@QuobyteHD {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:18:23 devstack sudo[88826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_chyvegtfdevstack@QuobyteHD Apr 28 19:18:23 devstack sudo[88826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:18:24 devstack sudo[88826]: pam_unix(sudo:session): session closed for user root Apr 28 19:18:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_chyvegtfdevstack@QuobyteHD" returned: 0 in 1.084s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:18:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:18:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:18:24 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:18:21Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a95647a3-ad00-47a8-b570-c2b77f5eaed5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc1948fb33ee4623afe433b535ba7283',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:18:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:18:21Z,use_quota=True,user_id='76eae2fdd3344aa28f0bb12673b1cb44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:18:24 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Creating volume a95647a3-ad00-47a8-b570-c2b77f5eaed5 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:18:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:18:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:18:24 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:18:24 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:18:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:18:24 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:18:24 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:18:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a95647a3-ad00-47a8-b570-c2b77f5eaed5 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:18:24 devstack sudo[88831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a95647a3-ad00-47a8-b570-c2b77f5eaed5 1073741824 Apr 28 19:18:24 devstack sudo[88831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:18:25 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-96d37fab-31f6-4549-945d-6b5f80847e19 tempest-VolumesActionsTest-1633652803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:18:25 devstack sudo[88831]: pam_unix(sudo:session): session closed for user root Apr 28 19:18:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-96d37fab-31f6-4549-945d-6b5f80847e19 tempest-VolumesActionsTest-1633652803 None] Flow 'volume_create_manager' (a8d56e57-84d8-43b8-8d0f-6a9a40427ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:18:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-96d37fab-31f6-4549-945d-6b5f80847e19 tempest-VolumesActionsTest-1633652803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a30b330b-2d6b-48a5-af2f-ab76a7f997f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:18:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a95647a3-ad00-47a8-b570-c2b77f5eaed5 1073741824" returned: 0 in 1.079s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:18:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-96d37fab-31f6-4549-945d-6b5f80847e19 tempest-VolumesActionsTest-1633652803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a30b330b-2d6b-48a5-af2f-ab76a7f997f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-996180562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46bdb193-8d43-49c3-9436-8cfb496d6c54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffd0fa05b7a842b6ae809e6562d6646c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:18:25Z,use_quota=True,user_id='a0f7db17ba2e4435b4f3ec6660b5cc46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:18:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-96d37fab-31f6-4549-945d-6b5f80847e19 tempest-VolumesActionsTest-1633652803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d084cb9a-d83d-455b-a394-25ed827eb092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:18:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-96d37fab-31f6-4549-945d-6b5f80847e19 tempest-VolumesActionsTest-1633652803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d084cb9a-d83d-455b-a394-25ed827eb092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:18:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-96d37fab-31f6-4549-945d-6b5f80847e19 tempest-VolumesActionsTest-1633652803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f65d6805-092c-4a4d-ad06-2f4e0d73bce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:18:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-96d37fab-31f6-4549-945d-6b5f80847e19 tempest-VolumesActionsTest-1633652803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f65d6805-092c-4a4d-ad06-2f4e0d73bce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46bdb193-8d43-49c3-9436-8cfb496d6c54', 'volume_name': 'volume-46bdb193-8d43-49c3-9436-8cfb496d6c54', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:18:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-96d37fab-31f6-4549-945d-6b5f80847e19 tempest-VolumesActionsTest-1633652803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ce93348-a9b1-4086-a509-e7c62b1d37ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:18:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-96d37fab-31f6-4549-945d-6b5f80847e19 tempest-VolumesActionsTest-1633652803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ce93348-a9b1-4086-a509-e7c62b1d37ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:18:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-96d37fab-31f6-4549-945d-6b5f80847e19 tempest-VolumesActionsTest-1633652803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f66e9c5-8909-4388-a341-a5aacc905b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:18:25 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-96d37fab-31f6-4549-945d-6b5f80847e19 tempest-VolumesActionsTest-1633652803 None] Volume 46bdb193-8d43-49c3-9436-8cfb496d6c54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46bdb193-8d43-49c3-9436-8cfb496d6c54', 'volume_size': 1} Apr 28 19:18:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-96d37fab-31f6-4549-945d-6b5f80847e19 tempest-VolumesActionsTest-1633652803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:18:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a95647a3-ad00-47a8-b570-c2b77f5eaed5 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:18:25 devstack sudo[88837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a95647a3-ad00-47a8-b570-c2b77f5eaed5 Apr 28 19:18:25 devstack sudo[88837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:18:26 devstack sudo[88837]: pam_unix(sudo:session): session closed for user root Apr 28 19:18:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a95647a3-ad00-47a8-b570-c2b77f5eaed5" returned: 0 in 0.633s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:18:26 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] <== create_volume: return (1820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:18:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.826s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:18:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-96d37fab-31f6-4549-945d-6b5f80847e19 tempest-VolumesActionsTest-1633652803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.667s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:18:26 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-96d37fab-31f6-4549-945d-6b5f80847e19 tempest-VolumesActionsTest-1633652803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-996180562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46bdb193-8d43-49c3-9436-8cfb496d6c54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffd0fa05b7a842b6ae809e6562d6646c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:18:25Z,use_quota=True,user_id='a0f7db17ba2e4435b4f3ec6660b5cc46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:18:26 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-96d37fab-31f6-4549-945d-6b5f80847e19 tempest-VolumesActionsTest-1633652803 None] Creating volume 46bdb193-8d43-49c3-9436-8cfb496d6c54 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:18:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-96d37fab-31f6-4549-945d-6b5f80847e19 tempest-VolumesActionsTest-1633652803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:18:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-96d37fab-31f6-4549-945d-6b5f80847e19 tempest-VolumesActionsTest-1633652803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:18:26 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-96d37fab-31f6-4549-945d-6b5f80847e19 tempest-VolumesActionsTest-1633652803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:18:26 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-96d37fab-31f6-4549-945d-6b5f80847e19 tempest-VolumesActionsTest-1633652803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:18:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-96d37fab-31f6-4549-945d-6b5f80847e19 tempest-VolumesActionsTest-1633652803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:18:26 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-96d37fab-31f6-4549-945d-6b5f80847e19 tempest-VolumesActionsTest-1633652803 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:18:26 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-96d37fab-31f6-4549-945d-6b5f80847e19 tempest-VolumesActionsTest-1633652803 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:18:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-96d37fab-31f6-4549-945d-6b5f80847e19 tempest-VolumesActionsTest-1633652803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-46bdb193-8d43-49c3-9436-8cfb496d6c54 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:18:26 devstack sudo[88840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-46bdb193-8d43-49c3-9436-8cfb496d6c54 1073741824 Apr 28 19:18:26 devstack sudo[88840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:18:26 devstack cinder-volume[83863]: DEBUG cinder.volume.volume_utils [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Attempting download of d11adb91-6b52-452f-a796-9ef8412183bf ((None, [{'url': 'file:///opt/stack/data/glance/images/d11adb91-6b52-452f-a796-9ef8412183bf', 'metadata': {}}])) to volume a95647a3-ad00-47a8-b570-c2b77f5eaed5. {{(pid=83863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 28 19:18:26 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c83938-71c1-4133-92a1-10c184985145]: (4, 'raw') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:18:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d11adb91-6b52-452f-a796-9ef8412183bf_7gjx_ugc {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:18:26 devstack sudo[88842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d11adb91-6b52-452f-a796-9ef8412183bf_7gjx_ugc Apr 28 19:18:26 devstack sudo[88842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:18:26 devstack sudo[88842]: pam_unix(sudo:session): session closed for user root Apr 28 19:18:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d11adb91-6b52-452f-a796-9ef8412183bf_7gjx_ugc" returned: 0 in 0.698s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:18:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d11adb91-6b52-452f-a796-9ef8412183bf_7gjx_ugc {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:18:27 devstack sudo[88840]: pam_unix(sudo:session): session closed for user root Apr 28 19:18:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-96d37fab-31f6-4549-945d-6b5f80847e19 tempest-VolumesActionsTest-1633652803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-46bdb193-8d43-49c3-9436-8cfb496d6c54 1073741824" returned: 0 in 0.870s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:18:27 devstack sudo[88850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d11adb91-6b52-452f-a796-9ef8412183bf_7gjx_ugc Apr 28 19:18:27 devstack sudo[88850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:18:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-96d37fab-31f6-4549-945d-6b5f80847e19 tempest-VolumesActionsTest-1633652803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-46bdb193-8d43-49c3-9436-8cfb496d6c54 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:18:27 devstack sudo[88852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-46bdb193-8d43-49c3-9436-8cfb496d6c54 Apr 28 19:18:27 devstack sudo[88852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:18:27 devstack sudo[88850]: pam_unix(sudo:session): session closed for user root Apr 28 19:18:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d11adb91-6b52-452f-a796-9ef8412183bf_7gjx_ugc" returned: 1 in 0.717s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:18:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d11adb91-6b52-452f-a796-9ef8412183bf_7gjx_ugc' failed. Not Retrying. {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 19:18:27 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[13251288-c55e-4177-9a39-ad7177f7e603]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:18:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_chyvegtfdevstack@QuobyteHD {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:18:27 devstack sudo[88852]: pam_unix(sudo:session): session closed for user root Apr 28 19:18:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-96d37fab-31f6-4549-945d-6b5f80847e19 tempest-VolumesActionsTest-1633652803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-46bdb193-8d43-49c3-9436-8cfb496d6c54" returned: 0 in 0.644s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:18:27 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-96d37fab-31f6-4549-945d-6b5f80847e19 tempest-VolumesActionsTest-1633652803 None] <== create_volume: return (1574ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:18:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-96d37fab-31f6-4549-945d-6b5f80847e19 tempest-VolumesActionsTest-1633652803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.579s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:18:27 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-96d37fab-31f6-4549-945d-6b5f80847e19 tempest-VolumesActionsTest-1633652803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f66e9c5-8909-4388-a341-a5aacc905b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46bdb193-8d43-49c3-9436-8cfb496d6c54', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:18:27 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-96d37fab-31f6-4549-945d-6b5f80847e19 tempest-VolumesActionsTest-1633652803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b41ad31b-56fe-4306-806a-50f4b784a6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:18:27 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-96d37fab-31f6-4549-945d-6b5f80847e19 tempest-VolumesActionsTest-1633652803 None] Volume volume-46bdb193-8d43-49c3-9436-8cfb496d6c54 (46bdb193-8d43-49c3-9436-8cfb496d6c54): created successfully Apr 28 19:18:27 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-96d37fab-31f6-4549-945d-6b5f80847e19 tempest-VolumesActionsTest-1633652803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b41ad31b-56fe-4306-806a-50f4b784a6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:18:27 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-96d37fab-31f6-4549-945d-6b5f80847e19 tempest-VolumesActionsTest-1633652803 None] Flow 'volume_create_manager' (a8d56e57-84d8-43b8-8d0f-6a9a40427ed4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:18:27 devstack sudo[88857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_chyvegtfdevstack@QuobyteHD Apr 28 19:18:27 devstack sudo[88857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:18:27 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-96d37fab-31f6-4549-945d-6b5f80847e19 tempest-VolumesActionsTest-1633652803 None] Created volume successfully. Apr 28 19:18:28 devstack sudo[88857]: pam_unix(sudo:session): session closed for user root Apr 28 19:18:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_chyvegtfdevstack@QuobyteHD" returned: 0 in 0.716s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:18:28 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] d11adb91-6b52-452f-a796-9ef8412183bf was qcow2, converting to raw {{(pid=83863) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 28 19:18:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_chyvegtfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a95647a3-ad00-47a8-b570-c2b77f5eaed5 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:18:28 devstack sudo[88862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_chyvegtfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a95647a3-ad00-47a8-b570-c2b77f5eaed5 Apr 28 19:18:28 devstack sudo[88862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:18:30 devstack sudo[88862]: pam_unix(sudo:session): session closed for user root Apr 28 19:18:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_chyvegtfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a95647a3-ad00-47a8-b570-c2b77f5eaed5" returned: 0 in 2.475s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:18:30 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_chyvegtfdevstack@QuobyteHD, size 112.00 MB, duration 2.48 sec, destination /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a95647a3-ad00-47a8-b570-c2b77f5eaed5 {{(pid=83863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 19:18:30 devstack cinder-volume[83863]: INFO cinder.image.image_utils [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Converted 112.00 MB image at 45.19 MB/s Apr 28 19:18:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a95647a3-ad00-47a8-b570-c2b77f5eaed5 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:18:30 devstack sudo[88890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a95647a3-ad00-47a8-b570-c2b77f5eaed5 1G Apr 28 19:18:30 devstack sudo[88890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:18:31 devstack sudo[88890]: pam_unix(sudo:session): session closed for user root Apr 28 19:18:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a95647a3-ad00-47a8-b570-c2b77f5eaed5 1G" returned: 0 in 0.765s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:18:31 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[342c5fb6-08ac-49a6-8f7f-5d34512a7283]: (4, 'raw') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:18:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a95647a3-ad00-47a8-b570-c2b77f5eaed5 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:18:31 devstack sudo[88896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a95647a3-ad00-47a8-b570-c2b77f5eaed5 Apr 28 19:18:31 devstack sudo[88896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:18:32 devstack sudo[88896]: pam_unix(sudo:session): session closed for user root Apr 28 19:18:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a95647a3-ad00-47a8-b570-c2b77f5eaed5" returned: 0 in 0.776s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:18:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a95647a3-ad00-47a8-b570-c2b77f5eaed5 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:18:32 devstack sudo[88900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a95647a3-ad00-47a8-b570-c2b77f5eaed5 Apr 28 19:18:32 devstack sudo[88900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:18:33 devstack sudo[88900]: pam_unix(sudo:session): session closed for user root Apr 28 19:18:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a95647a3-ad00-47a8-b570-c2b77f5eaed5" returned: 1 in 0.714s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:18:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a95647a3-ad00-47a8-b570-c2b77f5eaed5' failed. Not Retrying. {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 19:18:33 devstack cinder-volume[83863]: DEBUG cinder.volume.volume_utils [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Downloaded image d11adb91-6b52-452f-a796-9ef8412183bf ((None, [{'url': 'file:///opt/stack/data/glance/images/d11adb91-6b52-452f-a796-9ef8412183bf', 'metadata': {}}])) to volume a95647a3-ad00-47a8-b570-c2b77f5eaed5 successfully. {{(pid=83863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 28 19:18:33 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Temporary image d11adb91-6b52-452f-a796-9ef8412183bf for user 76eae2fdd3344aa28f0bb12673b1cb44 is deleted. {{(pid=83863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 28 19:18:33 devstack cinder-volume[83863]: DEBUG cinder.volume.volume_utils [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Marking volume a95647a3-ad00-47a8-b570-c2b77f5eaed5 as bootable. {{(pid=83863) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 28 19:18:33 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:SELECT=94,cinder:INSERT=37,cinder:UPDATE=144,cinder:DELETE=12 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 19:18:33 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Copying metadata from image d11adb91-6b52-452f-a796-9ef8412183bf to a95647a3-ad00-47a8-b570-c2b77f5eaed5. {{(pid=83863) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 28 19:18:33 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Creating volume glance metadata for volume a95647a3-ad00-47a8-b570-c2b77f5eaed5 backed by image d11adb91-6b52-452f-a796-9ef8412183bf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd11adb91-6b52-452f-a796-9ef8412183bf', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83863) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 28 19:18:33 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:UPDATE=149,cinder:DELETE=12,cinder:SELECT=107,cinder:INSERT=35 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 19:18:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d2d3fd4-4cdc-4e13-be89-1e01e8c54099) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a95647a3-ad00-47a8-b570-c2b77f5eaed5', 'volume_size': 1, 'image_id': 'd11adb91-6b52-452f-a796-9ef8412183bf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d11adb91-6b52-452f-a796-9ef8412183bf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6469daf89505401a8582e1f501a60d80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd11adb91-6b52-452f-a796-9ef8412183bf', 'created_at': datetime.datetime(2026, 4, 28, 17, 9, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 17, 9, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d11adb91-6b52-452f-a796-9ef8412183bf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:18:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0988a83f-64e1-4a04-a9fe-14b0d3deaeee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:18:33 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Volume volume-a95647a3-ad00-47a8-b570-c2b77f5eaed5 (a95647a3-ad00-47a8-b570-c2b77f5eaed5): created successfully Apr 28 19:18:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0988a83f-64e1-4a04-a9fe-14b0d3deaeee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:18:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Flow 'volume_create_manager' (2fa4af65-3291-41c8-b1eb-c8457b25fb59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:18:33 devstack cinder-volume[83863]: INFO cinder.volume.manager [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-0cef6eeb-3287-49f7-9932-a17d0f16ad2e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Created volume successfully. Apr 28 19:18:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-12b0737b-ceb5-4b43-addf-d53c4775deb7 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:18:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-12b0737b-ceb5-4b43-addf-d53c4775deb7 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:18:34 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9785db16-c45d-4064-8731-7b24a46c490f]: (4, 'raw') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:18:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-12b0737b-ceb5-4b43-addf-d53c4775deb7 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a95647a3-ad00-47a8-b570-c2b77f5eaed5 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:18:34 devstack sudo[88949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a95647a3-ad00-47a8-b570-c2b77f5eaed5 Apr 28 19:18:34 devstack sudo[88949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:18:35 devstack sudo[88949]: pam_unix(sudo:session): session closed for user root Apr 28 19:18:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-12b0737b-ceb5-4b43-addf-d53c4775deb7 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a95647a3-ad00-47a8-b570-c2b77f5eaed5" returned: 0 in 0.756s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:18:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-12b0737b-ceb5-4b43-addf-d53c4775deb7 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a95647a3-ad00-47a8-b570-c2b77f5eaed5 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:18:35 devstack sudo[88953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a95647a3-ad00-47a8-b570-c2b77f5eaed5 Apr 28 19:18:35 devstack sudo[88953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:18:35 devstack sudo[88953]: pam_unix(sudo:session): session closed for user root Apr 28 19:18:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-12b0737b-ceb5-4b43-addf-d53c4775deb7 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a95647a3-ad00-47a8-b570-c2b77f5eaed5" returned: 1 in 0.819s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:18:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-12b0737b-ceb5-4b43-addf-d53c4775deb7 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a95647a3-ad00-47a8-b570-c2b77f5eaed5' failed. Not Retrying. {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 19:18:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-12b0737b-ceb5-4b43-addf-d53c4775deb7 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.618s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:18:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-12b0737b-ceb5-4b43-addf-d53c4775deb7 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd', 'name': 'volume-a95647a3-ad00-47a8-b570-c2b77f5eaed5', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '71ef42a3-fc6f-4054-82b9-ad52f0ea88da', 'enforce_multipath': True} {{(pid=83863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 28 19:18:35 devstack cinder-volume[83863]: INFO cinder.volume.manager [req-1a1e15bd-f845-4962-8b4a-c4487af70c2d req-12b0737b-ceb5-4b43-addf-d53c4775deb7 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] attachment_update completed successfully. Apr 28 19:18:45 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:SELECT=16,cinder:INSERT=9,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 19:18:45 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:INSERT=3,cinder:SELECT=7,cinder:UPDATE=4 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 19:18:49 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-28db83ef-b5b2-4689-b7bc-4a4f4dcc3f6b tempest-VolumesActionsTest-1633652803 None] Acquiring lock "cinder-46bdb193-8d43-49c3-9436-8cfb496d6c54" by "attach_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:18:49 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-28db83ef-b5b2-4689-b7bc-4a4f4dcc3f6b tempest-VolumesActionsTest-1633652803 None] Lock "cinder-46bdb193-8d43-49c3-9436-8cfb496d6c54" acquired by "attach_volume" :: waited 0.027s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:18:49 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-28db83ef-b5b2-4689-b7bc-4a4f4dcc3f6b tempest-VolumesActionsTest-1633652803 None] Attaching volume 46bdb193-8d43-49c3-9436-8cfb496d6c54 to instance 3a2f134f-9cc5-4676-b0f1-c8ff411077b5 at mountpoint /dev/vdb on host None. Apr 28 19:18:49 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-28db83ef-b5b2-4689-b7bc-4a4f4dcc3f6b tempest-VolumesActionsTest-1633652803 None] Attach volume completed successfully. Apr 28 19:18:49 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-28db83ef-b5b2-4689-b7bc-4a4f4dcc3f6b tempest-VolumesActionsTest-1633652803 None] Lock "cinder-46bdb193-8d43-49c3-9436-8cfb496d6c54" released by "attach_volume" :: held 0.263s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:18:50 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6701695b-362c-42e0-8369-1183d9eda7d4 tempest-VolumesActionsTest-1633652803 None] Acquiring lock "cinder-46bdb193-8d43-49c3-9436-8cfb496d6c54-detach_volume" by "detach_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:18:50 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6701695b-362c-42e0-8369-1183d9eda7d4 tempest-VolumesActionsTest-1633652803 None] Lock "cinder-46bdb193-8d43-49c3-9436-8cfb496d6c54-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:18:50 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-6701695b-362c-42e0-8369-1183d9eda7d4 tempest-VolumesActionsTest-1633652803 None] Detaching volume 46bdb193-8d43-49c3-9436-8cfb496d6c54 from instance 3a2f134f-9cc5-4676-b0f1-c8ff411077b5. Apr 28 19:18:50 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-6701695b-362c-42e0-8369-1183d9eda7d4 tempest-VolumesActionsTest-1633652803 None] Detach volume completed successfully. Apr 28 19:18:50 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6701695b-362c-42e0-8369-1183d9eda7d4 tempest-VolumesActionsTest-1633652803 None] Lock "cinder-46bdb193-8d43-49c3-9436-8cfb496d6c54-detach_volume" released by "detach_volume" :: held 0.131s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:19:00 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 19:19:00 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 19:19:03 devstack cinder-volume[83863]: DEBUG oslo_service.periodic_task [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 28 19:19:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:19:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:19:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:19:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:19:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:19:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:19:03 devstack sudo[89261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:19:03 devstack sudo[89261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:19:04 devstack sudo[89261]: pam_unix(sudo:session): session closed for user root Apr 28 19:19:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 1.472s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:19:04 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:19:15 devstack cinder-volume[83863]: INFO cinder.volume.manager [req-6e0951bf-bb31-41fa-9e3f-8a71982849fe req-a058798c-0fc2-4a04-ae3f-6e31128fd1f0 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Terminate volume connection completed successfully. Apr 28 19:19:15 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-6e0951bf-bb31-41fa-9e3f-8a71982849fe req-a058798c-0fc2-4a04-ae3f-6e31128fd1f0 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Deleting attachment 71ef42a3-fc6f-4054-82b9-ad52f0ea88da. {{(pid=83863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 28 19:19:15 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-6e0951bf-bb31-41fa-9e3f-8a71982849fe req-dc67fe65-cc91-4e26-a051-8ea4c4db13b2 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Acquiring lock "cinder-a95647a3-ad00-47a8-b570-c2b77f5eaed5-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:19:16 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-6e0951bf-bb31-41fa-9e3f-8a71982849fe req-dc67fe65-cc91-4e26-a051-8ea4c4db13b2 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Lock "cinder-a95647a3-ad00-47a8-b570-c2b77f5eaed5-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:19:16 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-6e0951bf-bb31-41fa-9e3f-8a71982849fe req-dc67fe65-cc91-4e26-a051-8ea4c4db13b2 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Acquiring lock "cinder-quobyte-a95647a3-ad00-47a8-b570-c2b77f5eaed5" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:19:16 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-6e0951bf-bb31-41fa-9e3f-8a71982849fe req-dc67fe65-cc91-4e26-a051-8ea4c4db13b2 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Lock "cinder-quobyte-a95647a3-ad00-47a8-b570-c2b77f5eaed5" acquired by "delete_volume" :: waited 0.023s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:19:16 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[61635654-5771-4723-8f47-c5228f98d793]: (4, 'raw') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:19:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-6e0951bf-bb31-41fa-9e3f-8a71982849fe req-dc67fe65-cc91-4e26-a051-8ea4c4db13b2 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a95647a3-ad00-47a8-b570-c2b77f5eaed5 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:19:16 devstack sudo[89585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a95647a3-ad00-47a8-b570-c2b77f5eaed5 Apr 28 19:19:16 devstack sudo[89585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:19:17 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-32d91745-c0e3-464f-adec-ec13b3a28554 tempest-VolumesActionsTest-1227654161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:19:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-32d91745-c0e3-464f-adec-ec13b3a28554 tempest-VolumesActionsTest-1227654161 None] Flow 'volume_create_manager' (e6de5164-a700-4a03-8616-cba75a6760a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:19:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-32d91745-c0e3-464f-adec-ec13b3a28554 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d0c5d40-ea9c-45ad-a441-a72e7f68b14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:19:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-32d91745-c0e3-464f-adec-ec13b3a28554 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d0c5d40-ea9c-45ad-a441-a72e7f68b14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-521341734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b4097e2-0e63-44dc-b9ef-b46a3f5a2174,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38e8856c75104814bef706d799fcb4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:19:17Z,use_quota=True,user_id='846797cf18734e7abb64f3e0f0e6c573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:19:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-32d91745-c0e3-464f-adec-ec13b3a28554 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e898b61-bbd2-4a2f-ba80-93d91c0166c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:19:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-32d91745-c0e3-464f-adec-ec13b3a28554 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e898b61-bbd2-4a2f-ba80-93d91c0166c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:19:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-32d91745-c0e3-464f-adec-ec13b3a28554 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44b4d290-5d63-4964-a23f-278e53ea3c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:19:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-32d91745-c0e3-464f-adec-ec13b3a28554 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44b4d290-5d63-4964-a23f-278e53ea3c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b4097e2-0e63-44dc-b9ef-b46a3f5a2174', 'volume_name': 'volume-5b4097e2-0e63-44dc-b9ef-b46a3f5a2174', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:19:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-32d91745-c0e3-464f-adec-ec13b3a28554 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c3ca57c-edc5-4119-8464-ca8a3b79fab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:19:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-32d91745-c0e3-464f-adec-ec13b3a28554 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c3ca57c-edc5-4119-8464-ca8a3b79fab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:19:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-32d91745-c0e3-464f-adec-ec13b3a28554 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (394ea3ea-3892-4aca-9453-4d8b1e80bb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:19:17 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-32d91745-c0e3-464f-adec-ec13b3a28554 tempest-VolumesActionsTest-1227654161 None] Volume 5b4097e2-0e63-44dc-b9ef-b46a3f5a2174: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b4097e2-0e63-44dc-b9ef-b46a3f5a2174', 'volume_size': 1} Apr 28 19:19:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-32d91745-c0e3-464f-adec-ec13b3a28554 tempest-VolumesActionsTest-1227654161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:19:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-32d91745-c0e3-464f-adec-ec13b3a28554 tempest-VolumesActionsTest-1227654161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:19:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-32d91745-c0e3-464f-adec-ec13b3a28554 tempest-VolumesActionsTest-1227654161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-521341734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b4097e2-0e63-44dc-b9ef-b46a3f5a2174,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38e8856c75104814bef706d799fcb4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:19:17Z,use_quota=True,user_id='846797cf18734e7abb64f3e0f0e6c573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:19:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-32d91745-c0e3-464f-adec-ec13b3a28554 tempest-VolumesActionsTest-1227654161 None] Creating volume 5b4097e2-0e63-44dc-b9ef-b46a3f5a2174 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:19:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-32d91745-c0e3-464f-adec-ec13b3a28554 tempest-VolumesActionsTest-1227654161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:19:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-32d91745-c0e3-464f-adec-ec13b3a28554 tempest-VolumesActionsTest-1227654161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:19:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-32d91745-c0e3-464f-adec-ec13b3a28554 tempest-VolumesActionsTest-1227654161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:19:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-32d91745-c0e3-464f-adec-ec13b3a28554 tempest-VolumesActionsTest-1227654161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:19:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-32d91745-c0e3-464f-adec-ec13b3a28554 tempest-VolumesActionsTest-1227654161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:19:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-32d91745-c0e3-464f-adec-ec13b3a28554 tempest-VolumesActionsTest-1227654161 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:19:17 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-32d91745-c0e3-464f-adec-ec13b3a28554 tempest-VolumesActionsTest-1227654161 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:19:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-32d91745-c0e3-464f-adec-ec13b3a28554 tempest-VolumesActionsTest-1227654161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5b4097e2-0e63-44dc-b9ef-b46a3f5a2174 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:19:17 devstack sudo[89587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5b4097e2-0e63-44dc-b9ef-b46a3f5a2174 1073741824 Apr 28 19:19:17 devstack sudo[89587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:19:17 devstack sudo[89585]: pam_unix(sudo:session): session closed for user root Apr 28 19:19:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-6e0951bf-bb31-41fa-9e3f-8a71982849fe req-dc67fe65-cc91-4e26-a051-8ea4c4db13b2 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a95647a3-ad00-47a8-b570-c2b77f5eaed5" returned: 0 in 1.333s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:19:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-6e0951bf-bb31-41fa-9e3f-8a71982849fe req-dc67fe65-cc91-4e26-a051-8ea4c4db13b2 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a95647a3-ad00-47a8-b570-c2b77f5eaed5 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:19:17 devstack sudo[89591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a95647a3-ad00-47a8-b570-c2b77f5eaed5 Apr 28 19:19:17 devstack sudo[89591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:19:18 devstack sudo[89587]: pam_unix(sudo:session): session closed for user root Apr 28 19:19:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-32d91745-c0e3-464f-adec-ec13b3a28554 tempest-VolumesActionsTest-1227654161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5b4097e2-0e63-44dc-b9ef-b46a3f5a2174 1073741824" returned: 0 in 1.174s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:19:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-32d91745-c0e3-464f-adec-ec13b3a28554 tempest-VolumesActionsTest-1227654161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5b4097e2-0e63-44dc-b9ef-b46a3f5a2174 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:19:18 devstack sudo[89591]: pam_unix(sudo:session): session closed for user root Apr 28 19:19:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-6e0951bf-bb31-41fa-9e3f-8a71982849fe req-dc67fe65-cc91-4e26-a051-8ea4c4db13b2 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a95647a3-ad00-47a8-b570-c2b77f5eaed5" returned: 1 in 1.053s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:19:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-6e0951bf-bb31-41fa-9e3f-8a71982849fe req-dc67fe65-cc91-4e26-a051-8ea4c4db13b2 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a95647a3-ad00-47a8-b570-c2b77f5eaed5' failed. Not Retrying. {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 19:19:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-6e0951bf-bb31-41fa-9e3f-8a71982849fe req-dc67fe65-cc91-4e26-a051-8ea4c4db13b2 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a95647a3-ad00-47a8-b570-c2b77f5eaed5 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:19:18 devstack sudo[89600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5b4097e2-0e63-44dc-b9ef-b46a3f5a2174 Apr 28 19:19:18 devstack sudo[89600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:19:18 devstack sudo[89601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a95647a3-ad00-47a8-b570-c2b77f5eaed5 Apr 28 19:19:18 devstack sudo[89601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:19:18 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-80dc4328-6cd9-45c2-a4f4-cb97434913dc tempest-VolumesActionsTest-1633652803 None] Acquiring lock "cinder-46bdb193-8d43-49c3-9436-8cfb496d6c54" by "attach_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:19:18 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-80dc4328-6cd9-45c2-a4f4-cb97434913dc tempest-VolumesActionsTest-1633652803 None] Lock "cinder-46bdb193-8d43-49c3-9436-8cfb496d6c54" acquired by "attach_volume" :: waited 0.045s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:19:19 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-80dc4328-6cd9-45c2-a4f4-cb97434913dc tempest-VolumesActionsTest-1633652803 None] Attaching volume 46bdb193-8d43-49c3-9436-8cfb496d6c54 to instance df7b46fa-3614-4832-9a03-2b37bb901e95 at mountpoint /dev/vdb on host None. Apr 28 19:19:19 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-80dc4328-6cd9-45c2-a4f4-cb97434913dc tempest-VolumesActionsTest-1633652803 None] Attach volume completed successfully. Apr 28 19:19:19 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-80dc4328-6cd9-45c2-a4f4-cb97434913dc tempest-VolumesActionsTest-1633652803 None] Lock "cinder-46bdb193-8d43-49c3-9436-8cfb496d6c54" released by "attach_volume" :: held 0.235s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:19:19 devstack sudo[89600]: pam_unix(sudo:session): session closed for user root Apr 28 19:19:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-32d91745-c0e3-464f-adec-ec13b3a28554 tempest-VolumesActionsTest-1227654161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5b4097e2-0e63-44dc-b9ef-b46a3f5a2174" returned: 0 in 0.910s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:19:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-32d91745-c0e3-464f-adec-ec13b3a28554 tempest-VolumesActionsTest-1227654161 None] <== create_volume: return (2187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:19:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-32d91745-c0e3-464f-adec-ec13b3a28554 tempest-VolumesActionsTest-1227654161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.190s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:19:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-32d91745-c0e3-464f-adec-ec13b3a28554 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (394ea3ea-3892-4aca-9453-4d8b1e80bb95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b4097e2-0e63-44dc-b9ef-b46a3f5a2174', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:19:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-32d91745-c0e3-464f-adec-ec13b3a28554 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be617f3a-c01a-4b05-aef2-fc297f877119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:19:19 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-32d91745-c0e3-464f-adec-ec13b3a28554 tempest-VolumesActionsTest-1227654161 None] Volume volume-5b4097e2-0e63-44dc-b9ef-b46a3f5a2174 (5b4097e2-0e63-44dc-b9ef-b46a3f5a2174): created successfully Apr 28 19:19:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-32d91745-c0e3-464f-adec-ec13b3a28554 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be617f3a-c01a-4b05-aef2-fc297f877119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:19:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-32d91745-c0e3-464f-adec-ec13b3a28554 tempest-VolumesActionsTest-1227654161 None] Flow 'volume_create_manager' (e6de5164-a700-4a03-8616-cba75a6760a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:19:19 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-32d91745-c0e3-464f-adec-ec13b3a28554 tempest-VolumesActionsTest-1227654161 None] Created volume successfully. Apr 28 19:19:19 devstack sudo[89601]: pam_unix(sudo:session): session closed for user root Apr 28 19:19:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-6e0951bf-bb31-41fa-9e3f-8a71982849fe req-dc67fe65-cc91-4e26-a051-8ea4c4db13b2 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a95647a3-ad00-47a8-b570-c2b77f5eaed5" returned: 0 in 1.079s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:19:19 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-6e0951bf-bb31-41fa-9e3f-8a71982849fe req-dc67fe65-cc91-4e26-a051-8ea4c4db13b2 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Lock "cinder-quobyte-a95647a3-ad00-47a8-b570-c2b77f5eaed5" released by "delete_volume" :: held 3.597s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:19:19 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-04141579-304f-4871-a3eb-da973e2c419a tempest-VolumesActionsTest-1633652803 None] Acquiring lock "cinder-46bdb193-8d43-49c3-9436-8cfb496d6c54-detach_volume" by "detach_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:19:19 devstack cinder-volume[83863]: DEBUG cinder.quota [req-6e0951bf-bb31-41fa-9e3f-8a71982849fe req-dc67fe65-cc91-4e26-a051-8ea4c4db13b2 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Created reservations ['3c03334b-b4dd-4a46-9702-0b20df037ead', '3b09056e-254c-46c8-b444-0c07a93b7f71', 'e6e618ed-918c-461c-a78c-5bade773f70d', '264ff615-a842-45b5-9f19-dad8c3431943'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:19:19 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-04141579-304f-4871-a3eb-da973e2c419a tempest-VolumesActionsTest-1633652803 None] Lock "cinder-46bdb193-8d43-49c3-9436-8cfb496d6c54-detach_volume" acquired by "detach_volume" :: waited 0.042s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:19:19 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-04141579-304f-4871-a3eb-da973e2c419a tempest-VolumesActionsTest-1633652803 None] Detaching volume 46bdb193-8d43-49c3-9436-8cfb496d6c54 from instance df7b46fa-3614-4832-9a03-2b37bb901e95. Apr 28 19:19:19 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-04141579-304f-4871-a3eb-da973e2c419a tempest-VolumesActionsTest-1633652803 None] Detach volume completed successfully. Apr 28 19:19:19 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-04141579-304f-4871-a3eb-da973e2c419a tempest-VolumesActionsTest-1633652803 None] Lock "cinder-46bdb193-8d43-49c3-9436-8cfb496d6c54-detach_volume" released by "detach_volume" :: held 0.114s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:19:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-6e0951bf-bb31-41fa-9e3f-8a71982849fe req-dc67fe65-cc91-4e26-a051-8ea4c4db13b2 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:19:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-6e0951bf-bb31-41fa-9e3f-8a71982849fe req-dc67fe65-cc91-4e26-a051-8ea4c4db13b2 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:19:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-6e0951bf-bb31-41fa-9e3f-8a71982849fe req-dc67fe65-cc91-4e26-a051-8ea4c4db13b2 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:19:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-6e0951bf-bb31-41fa-9e3f-8a71982849fe req-dc67fe65-cc91-4e26-a051-8ea4c4db13b2 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:19:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-6e0951bf-bb31-41fa-9e3f-8a71982849fe req-dc67fe65-cc91-4e26-a051-8ea4c4db13b2 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:19:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-6e0951bf-bb31-41fa-9e3f-8a71982849fe req-dc67fe65-cc91-4e26-a051-8ea4c4db13b2 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:19:20 devstack sudo[89606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:19:20 devstack sudo[89606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:19:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c9b338c4-2616-4449-a189-f27e7d845854 tempest-VolumesActionsTest-1227654161 None] Acquiring lock "cinder-5b4097e2-0e63-44dc-b9ef-b46a3f5a2174" by "attach_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:19:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c9b338c4-2616-4449-a189-f27e7d845854 tempest-VolumesActionsTest-1227654161 None] Lock "cinder-5b4097e2-0e63-44dc-b9ef-b46a3f5a2174" acquired by "attach_volume" :: waited 0.103s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:19:20 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-c9b338c4-2616-4449-a189-f27e7d845854 tempest-VolumesActionsTest-1227654161 None] Attaching volume 5b4097e2-0e63-44dc-b9ef-b46a3f5a2174 to instance cd49050b-581d-449b-ac34-5e014f02955a at mountpoint /dev/vdb on host None. Apr 28 19:19:21 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-c9b338c4-2616-4449-a189-f27e7d845854 tempest-VolumesActionsTest-1227654161 None] Attach volume completed successfully. Apr 28 19:19:21 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c9b338c4-2616-4449-a189-f27e7d845854 tempest-VolumesActionsTest-1227654161 None] Lock "cinder-5b4097e2-0e63-44dc-b9ef-b46a3f5a2174" released by "attach_volume" :: held 0.361s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:19:21 devstack sudo[89606]: pam_unix(sudo:session): session closed for user root Apr 28 19:19:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-6e0951bf-bb31-41fa-9e3f-8a71982849fe req-dc67fe65-cc91-4e26-a051-8ea4c4db13b2 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 1.171s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:19:21 devstack cinder-volume[83863]: DEBUG cinder.manager [req-6e0951bf-bb31-41fa-9e3f-8a71982849fe req-dc67fe65-cc91-4e26-a051-8ea4c4db13b2 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:19:21 devstack cinder-volume[83863]: INFO cinder.volume.manager [req-6e0951bf-bb31-41fa-9e3f-8a71982849fe req-dc67fe65-cc91-4e26-a051-8ea4c4db13b2 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Deleted volume successfully. Apr 28 19:19:21 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-6e0951bf-bb31-41fa-9e3f-8a71982849fe req-dc67fe65-cc91-4e26-a051-8ea4c4db13b2 tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Lock "cinder-a95647a3-ad00-47a8-b570-c2b77f5eaed5-delete_volume" released by "delete_volume" :: held 5.266s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:19:22 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-ddfc0d50-62e6-4242-b38b-b00186fb61d9 tempest-VolumesActionsTest-2078684481 None] Terminate volume connection completed successfully. Apr 28 19:19:22 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ddfc0d50-62e6-4242-b38b-b00186fb61d9 tempest-VolumesActionsTest-2078684481 None] Acquiring lock "cinder-5b4097e2-0e63-44dc-b9ef-b46a3f5a2174-detach_volume" by "detach_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:19:22 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ddfc0d50-62e6-4242-b38b-b00186fb61d9 tempest-VolumesActionsTest-2078684481 None] Lock "cinder-5b4097e2-0e63-44dc-b9ef-b46a3f5a2174-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:19:22 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-ddfc0d50-62e6-4242-b38b-b00186fb61d9 tempest-VolumesActionsTest-2078684481 None] Detaching volume 5b4097e2-0e63-44dc-b9ef-b46a3f5a2174 from instance cd49050b-581d-449b-ac34-5e014f02955a. Apr 28 19:19:23 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-ddfc0d50-62e6-4242-b38b-b00186fb61d9 tempest-VolumesActionsTest-2078684481 None] Detach volume completed successfully. Apr 28 19:19:23 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ddfc0d50-62e6-4242-b38b-b00186fb61d9 tempest-VolumesActionsTest-2078684481 None] Lock "cinder-5b4097e2-0e63-44dc-b9ef-b46a3f5a2174-detach_volume" released by "detach_volume" :: held 0.101s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:19:23 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a967a081-9bd6-42e7-afaa-11d92dfe9a5c tempest-VolumesActionsTest-1227654161 None] Acquiring lock "cinder-5b4097e2-0e63-44dc-b9ef-b46a3f5a2174-detach_volume" by "detach_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:19:23 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a967a081-9bd6-42e7-afaa-11d92dfe9a5c tempest-VolumesActionsTest-1227654161 None] Lock "cinder-5b4097e2-0e63-44dc-b9ef-b46a3f5a2174-detach_volume" acquired by "detach_volume" :: waited 0.038s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:19:23 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-a967a081-9bd6-42e7-afaa-11d92dfe9a5c tempest-VolumesActionsTest-1227654161 None] Volume detach called, but volume not attached. Apr 28 19:19:23 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a967a081-9bd6-42e7-afaa-11d92dfe9a5c tempest-VolumesActionsTest-1227654161 None] Lock "cinder-5b4097e2-0e63-44dc-b9ef-b46a3f5a2174-detach_volume" released by "detach_volume" :: held 0.033s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:19:24 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e66ffb1d-3085-48cb-8ccc-12660096e00a tempest-VolumesActionsTest-1227654161 None] Acquiring lock "cinder-5b4097e2-0e63-44dc-b9ef-b46a3f5a2174-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:19:24 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e66ffb1d-3085-48cb-8ccc-12660096e00a tempest-VolumesActionsTest-1227654161 None] Lock "cinder-5b4097e2-0e63-44dc-b9ef-b46a3f5a2174-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:19:24 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e66ffb1d-3085-48cb-8ccc-12660096e00a tempest-VolumesActionsTest-1227654161 None] Acquiring lock "cinder-quobyte-5b4097e2-0e63-44dc-b9ef-b46a3f5a2174" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:19:24 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e66ffb1d-3085-48cb-8ccc-12660096e00a tempest-VolumesActionsTest-1227654161 None] Lock "cinder-quobyte-5b4097e2-0e63-44dc-b9ef-b46a3f5a2174" acquired by "delete_volume" :: waited 0.021s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:19:24 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[38998c92-5147-419b-9a83-6abc935c6938]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:19:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e66ffb1d-3085-48cb-8ccc-12660096e00a tempest-VolumesActionsTest-1227654161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5b4097e2-0e63-44dc-b9ef-b46a3f5a2174 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:19:24 devstack sudo[89707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5b4097e2-0e63-44dc-b9ef-b46a3f5a2174 Apr 28 19:19:24 devstack sudo[89707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:19:25 devstack sudo[89707]: pam_unix(sudo:session): session closed for user root Apr 28 19:19:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e66ffb1d-3085-48cb-8ccc-12660096e00a tempest-VolumesActionsTest-1227654161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5b4097e2-0e63-44dc-b9ef-b46a3f5a2174" returned: 0 in 0.885s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:19:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e66ffb1d-3085-48cb-8ccc-12660096e00a tempest-VolumesActionsTest-1227654161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5b4097e2-0e63-44dc-b9ef-b46a3f5a2174 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:19:25 devstack sudo[89712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5b4097e2-0e63-44dc-b9ef-b46a3f5a2174 Apr 28 19:19:25 devstack sudo[89712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:19:26 devstack sudo[89712]: pam_unix(sudo:session): session closed for user root Apr 28 19:19:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e66ffb1d-3085-48cb-8ccc-12660096e00a tempest-VolumesActionsTest-1227654161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5b4097e2-0e63-44dc-b9ef-b46a3f5a2174" returned: 0 in 0.649s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:19:26 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e66ffb1d-3085-48cb-8ccc-12660096e00a tempest-VolumesActionsTest-1227654161 None] Lock "cinder-quobyte-5b4097e2-0e63-44dc-b9ef-b46a3f5a2174" released by "delete_volume" :: held 1.595s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:19:26 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-e66ffb1d-3085-48cb-8ccc-12660096e00a tempest-VolumesActionsTest-1227654161 None] Created reservations ['ef42c701-dfd5-447f-9abb-68417e7fc3c0', 'bb5592b2-ad1f-4dd5-b7f3-e50537e04a20', '6ce92cee-ffeb-4240-a875-011e0971b1b0', '69cdde4e-f2c4-4ae6-85e0-c4fcf3c1321d'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:19:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e66ffb1d-3085-48cb-8ccc-12660096e00a tempest-VolumesActionsTest-1227654161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:19:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e66ffb1d-3085-48cb-8ccc-12660096e00a tempest-VolumesActionsTest-1227654161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:19:26 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-e66ffb1d-3085-48cb-8ccc-12660096e00a tempest-VolumesActionsTest-1227654161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:19:26 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-e66ffb1d-3085-48cb-8ccc-12660096e00a tempest-VolumesActionsTest-1227654161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:19:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e66ffb1d-3085-48cb-8ccc-12660096e00a tempest-VolumesActionsTest-1227654161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:19:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e66ffb1d-3085-48cb-8ccc-12660096e00a tempest-VolumesActionsTest-1227654161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:19:26 devstack sudo[89715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:19:26 devstack sudo[89715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:19:27 devstack sudo[89715]: pam_unix(sudo:session): session closed for user root Apr 28 19:19:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e66ffb1d-3085-48cb-8ccc-12660096e00a tempest-VolumesActionsTest-1227654161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.864s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:19:27 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-e66ffb1d-3085-48cb-8ccc-12660096e00a tempest-VolumesActionsTest-1227654161 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:19:27 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-e66ffb1d-3085-48cb-8ccc-12660096e00a tempest-VolumesActionsTest-1227654161 None] Deleted volume successfully. Apr 28 19:19:27 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e66ffb1d-3085-48cb-8ccc-12660096e00a tempest-VolumesActionsTest-1227654161 None] Lock "cinder-5b4097e2-0e63-44dc-b9ef-b46a3f5a2174-delete_volume" released by "delete_volume" :: held 2.687s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:19:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e8f6978f-d96b-4cc1-9ad7-0a2c0ac3c279 tempest-VolumesActionsTest-1633652803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:19:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e8f6978f-d96b-4cc1-9ad7-0a2c0ac3c279 tempest-VolumesActionsTest-1633652803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:19:29 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddd3cea-f8cd-4716-bb03-7159ebf3d79d]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:19:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e8f6978f-d96b-4cc1-9ad7-0a2c0ac3c279 tempest-VolumesActionsTest-1633652803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-46bdb193-8d43-49c3-9436-8cfb496d6c54 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:19:29 devstack sudo[89784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-46bdb193-8d43-49c3-9436-8cfb496d6c54 Apr 28 19:19:29 devstack sudo[89784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:19:30 devstack sudo[89784]: pam_unix(sudo:session): session closed for user root Apr 28 19:19:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e8f6978f-d96b-4cc1-9ad7-0a2c0ac3c279 tempest-VolumesActionsTest-1633652803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-46bdb193-8d43-49c3-9436-8cfb496d6c54" returned: 0 in 1.004s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:19:30 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ecf9368-1eba-445f-a3e6-d564440f33e7]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:19:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e8f6978f-d96b-4cc1-9ad7-0a2c0ac3c279 tempest-VolumesActionsTest-1633652803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-46bdb193-8d43-49c3-9436-8cfb496d6c54 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:19:30 devstack sudo[89824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-46bdb193-8d43-49c3-9436-8cfb496d6c54 Apr 28 19:19:30 devstack sudo[89824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:19:31 devstack sudo[89824]: pam_unix(sudo:session): session closed for user root Apr 28 19:19:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e8f6978f-d96b-4cc1-9ad7-0a2c0ac3c279 tempest-VolumesActionsTest-1633652803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-46bdb193-8d43-49c3-9436-8cfb496d6c54" returned: 0 in 0.851s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:19:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e8f6978f-d96b-4cc1-9ad7-0a2c0ac3c279 tempest-VolumesActionsTest-1633652803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-46bdb193-8d43-49c3-9436-8cfb496d6c54 /opt/stack/data/cinder/conversion/46bdb193-8d43-49c3-9436-8cfb496d6c54.temp_image.1c5e4bbf-919e-47a9-bcec-d6184ba1f7a8c4yadtt6.img {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:19:31 devstack sudo[89833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-46bdb193-8d43-49c3-9436-8cfb496d6c54 /opt/stack/data/cinder/conversion/46bdb193-8d43-49c3-9436-8cfb496d6c54.temp_image.1c5e4bbf-919e-47a9-bcec-d6184ba1f7a8c4yadtt6.img Apr 28 19:19:31 devstack sudo[89833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:19:33 devstack cinder-volume[83863]: INFO cinder.volume.manager [req-0d93a22f-af66-486e-90c0-4123ec0f85fe req-a197dd43-6d06-4166-a4b3-e84cc0033a1e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Terminate volume connection completed successfully. Apr 28 19:19:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-0d93a22f-af66-486e-90c0-4123ec0f85fe req-a197dd43-6d06-4166-a4b3-e84cc0033a1e tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Deleting attachment f30928ca-069e-447f-b479-074b9d3a4f72. {{(pid=83863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 28 19:19:34 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-0d93a22f-af66-486e-90c0-4123ec0f85fe req-ce592c26-89b4-47bd-b62a-08f4d4b5dbda tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Acquiring lock "cinder-c07d1a36-dd01-4e4f-84b2-ad728bd12c58-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:19:34 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-0d93a22f-af66-486e-90c0-4123ec0f85fe req-ce592c26-89b4-47bd-b62a-08f4d4b5dbda tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Lock "cinder-c07d1a36-dd01-4e4f-84b2-ad728bd12c58-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:19:34 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-0d93a22f-af66-486e-90c0-4123ec0f85fe req-ce592c26-89b4-47bd-b62a-08f4d4b5dbda tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Acquiring lock "cinder-quobyte-c07d1a36-dd01-4e4f-84b2-ad728bd12c58" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:19:34 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-0d93a22f-af66-486e-90c0-4123ec0f85fe req-ce592c26-89b4-47bd-b62a-08f4d4b5dbda tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Lock "cinder-quobyte-c07d1a36-dd01-4e4f-84b2-ad728bd12c58" acquired by "delete_volume" :: waited 0.075s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:19:34 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0edabc4-6212-4c01-96f0-076d4f9ed146]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:19:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-0d93a22f-af66-486e-90c0-4123ec0f85fe req-ce592c26-89b4-47bd-b62a-08f4d4b5dbda tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c07d1a36-dd01-4e4f-84b2-ad728bd12c58 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:19:34 devstack sudo[89881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c07d1a36-dd01-4e4f-84b2-ad728bd12c58 Apr 28 19:19:34 devstack sudo[89881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:19:36 devstack sudo[89881]: pam_unix(sudo:session): session closed for user root Apr 28 19:19:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-0d93a22f-af66-486e-90c0-4123ec0f85fe req-ce592c26-89b4-47bd-b62a-08f4d4b5dbda tempest-ServerBootFromVolumeStableRescueTest-647471535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c07d1a36-dd01-4e4f-84b2-ad728bd12c58" returned: 0 in 1.566s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:19:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-0d93a22f-af66-486e-90c0-4123ec0f85fe req-ce592c26-89b4-47bd-b62a-08f4d4b5dbda tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c07d1a36-dd01-4e4f-84b2-ad728bd12c58 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:19:36 devstack sudo[89889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c07d1a36-dd01-4e4f-84b2-ad728bd12c58 Apr 28 19:19:36 devstack sudo[89889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:19:37 devstack sudo[89889]: pam_unix(sudo:session): session closed for user root Apr 28 19:19:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-0d93a22f-af66-486e-90c0-4123ec0f85fe req-ce592c26-89b4-47bd-b62a-08f4d4b5dbda tempest-ServerBootFromVolumeStableRescueTest-647471535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c07d1a36-dd01-4e4f-84b2-ad728bd12c58" returned: 0 in 1.301s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:19:37 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-0d93a22f-af66-486e-90c0-4123ec0f85fe req-ce592c26-89b4-47bd-b62a-08f4d4b5dbda tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Lock "cinder-quobyte-c07d1a36-dd01-4e4f-84b2-ad728bd12c58" released by "delete_volume" :: held 2.988s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:19:37 devstack cinder-volume[83863]: DEBUG cinder.quota [req-0d93a22f-af66-486e-90c0-4123ec0f85fe req-ce592c26-89b4-47bd-b62a-08f4d4b5dbda tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Created reservations ['28afbdfb-97fa-4db6-abb2-4c0e1a288bd1', 'e1bc28bd-d56d-4ca4-b68d-acac9616c788', 'd9123069-6d40-4b21-a06d-0243735d169b', '12691224-8d50-464a-88b0-f7032f047322'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:19:37 devstack sudo[89833]: pam_unix(sudo:session): session closed for user root Apr 28 19:19:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e8f6978f-d96b-4cc1-9ad7-0a2c0ac3c279 tempest-VolumesActionsTest-1633652803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-46bdb193-8d43-49c3-9436-8cfb496d6c54 /opt/stack/data/cinder/conversion/46bdb193-8d43-49c3-9436-8cfb496d6c54.temp_image.1c5e4bbf-919e-47a9-bcec-d6184ba1f7a8c4yadtt6.img" returned: 0 in 6.034s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:19:37 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[16871e81-11ec-4653-8321-3517f765155b]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:19:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e8f6978f-d96b-4cc1-9ad7-0a2c0ac3c279 tempest-VolumesActionsTest-1633652803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-46bdb193-8d43-49c3-9436-8cfb496d6c54 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:19:37 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-7efc33fd-67d4-4728-bf95-1c3d75fe2a79 tempest-VolumesActionsTest-1227654161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:19:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7efc33fd-67d4-4728-bf95-1c3d75fe2a79 tempest-VolumesActionsTest-1227654161 None] Flow 'volume_create_manager' (c84b4024-a084-477e-9f74-a5baafe2bae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:19:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7efc33fd-67d4-4728-bf95-1c3d75fe2a79 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ef34c58-2f9e-411c-a91f-93acbf6dbbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:19:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7efc33fd-67d4-4728-bf95-1c3d75fe2a79 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ef34c58-2f9e-411c-a91f-93acbf6dbbfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:19:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-765561114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7138186-9996-4cc3-885b-d2d0d5fd06f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38e8856c75104814bef706d799fcb4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:19:38Z,use_quota=True,user_id='846797cf18734e7abb64f3e0f0e6c573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:19:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7efc33fd-67d4-4728-bf95-1c3d75fe2a79 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7d8c883-7dc4-4fcd-9be2-21fa1f0246bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:19:37 devstack sudo[89892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-46bdb193-8d43-49c3-9436-8cfb496d6c54 Apr 28 19:19:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7efc33fd-67d4-4728-bf95-1c3d75fe2a79 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7d8c883-7dc4-4fcd-9be2-21fa1f0246bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:19:37 devstack sudo[89892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:19:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7efc33fd-67d4-4728-bf95-1c3d75fe2a79 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd08efc-bed4-4d0d-85e7-68aeaf2af228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:19:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7efc33fd-67d4-4728-bf95-1c3d75fe2a79 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd08efc-bed4-4d0d-85e7-68aeaf2af228) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7138186-9996-4cc3-885b-d2d0d5fd06f3', 'volume_name': 'volume-d7138186-9996-4cc3-885b-d2d0d5fd06f3', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:19:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7efc33fd-67d4-4728-bf95-1c3d75fe2a79 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0c6b675-2ec9-40c7-b20b-a7a2ba071981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:19:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7efc33fd-67d4-4728-bf95-1c3d75fe2a79 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0c6b675-2ec9-40c7-b20b-a7a2ba071981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:19:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7efc33fd-67d4-4728-bf95-1c3d75fe2a79 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (785d996a-0528-440b-a869-3effdbcef977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:19:37 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-7efc33fd-67d4-4728-bf95-1c3d75fe2a79 tempest-VolumesActionsTest-1227654161 None] Volume d7138186-9996-4cc3-885b-d2d0d5fd06f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7138186-9996-4cc3-885b-d2d0d5fd06f3', 'volume_size': 1} Apr 28 19:19:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7efc33fd-67d4-4728-bf95-1c3d75fe2a79 tempest-VolumesActionsTest-1227654161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:19:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-0d93a22f-af66-486e-90c0-4123ec0f85fe req-ce592c26-89b4-47bd-b62a-08f4d4b5dbda tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:19:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-0d93a22f-af66-486e-90c0-4123ec0f85fe req-ce592c26-89b4-47bd-b62a-08f4d4b5dbda tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:19:37 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-0d93a22f-af66-486e-90c0-4123ec0f85fe req-ce592c26-89b4-47bd-b62a-08f4d4b5dbda tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:19:37 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-0d93a22f-af66-486e-90c0-4123ec0f85fe req-ce592c26-89b4-47bd-b62a-08f4d4b5dbda tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:19:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-0d93a22f-af66-486e-90c0-4123ec0f85fe req-ce592c26-89b4-47bd-b62a-08f4d4b5dbda tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:19:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-0d93a22f-af66-486e-90c0-4123ec0f85fe req-ce592c26-89b4-47bd-b62a-08f4d4b5dbda tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:19:37 devstack sudo[89894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:19:37 devstack sudo[89894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:19:38 devstack sudo[89894]: pam_unix(sudo:session): session closed for user root Apr 28 19:19:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-0d93a22f-af66-486e-90c0-4123ec0f85fe req-ce592c26-89b4-47bd-b62a-08f4d4b5dbda tempest-ServerBootFromVolumeStableRescueTest-647471535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.624s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:19:38 devstack cinder-volume[83863]: DEBUG cinder.manager [req-0d93a22f-af66-486e-90c0-4123ec0f85fe req-ce592c26-89b4-47bd-b62a-08f4d4b5dbda tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:19:38 devstack cinder-volume[83863]: INFO cinder.volume.manager [req-0d93a22f-af66-486e-90c0-4123ec0f85fe req-ce592c26-89b4-47bd-b62a-08f4d4b5dbda tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Deleted volume successfully. Apr 28 19:19:38 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-0d93a22f-af66-486e-90c0-4123ec0f85fe req-ce592c26-89b4-47bd-b62a-08f4d4b5dbda tempest-ServerBootFromVolumeStableRescueTest-647471535 None] Lock "cinder-c07d1a36-dd01-4e4f-84b2-ad728bd12c58-delete_volume" released by "delete_volume" :: held 4.063s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:19:38 devstack sudo[89892]: pam_unix(sudo:session): session closed for user root Apr 28 19:19:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e8f6978f-d96b-4cc1-9ad7-0a2c0ac3c279 tempest-VolumesActionsTest-1633652803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-46bdb193-8d43-49c3-9436-8cfb496d6c54" returned: 0 in 0.944s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:19:38 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-e8f6978f-d96b-4cc1-9ad7-0a2c0ac3c279 tempest-VolumesActionsTest-1633652803 None] Image conversion details: src /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-46bdb193-8d43-49c3-9436-8cfb496d6c54, size 1024.00 MB, duration 6.04 sec, destination /opt/stack/data/cinder/conversion/46bdb193-8d43-49c3-9436-8cfb496d6c54.temp_image.1c5e4bbf-919e-47a9-bcec-d6184ba1f7a8c4yadtt6.img {{(pid=83863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 19:19:38 devstack cinder-volume[83863]: INFO cinder.image.image_utils [None req-e8f6978f-d96b-4cc1-9ad7-0a2c0ac3c279 tempest-VolumesActionsTest-1633652803 None] Converted 1024.00 MB image at 169.63 MB/s Apr 28 19:19:38 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-e8f6978f-d96b-4cc1-9ad7-0a2c0ac3c279 tempest-VolumesActionsTest-1633652803 None] 1c5e4bbf-919e-47a9-bcec-d6184ba1f7a8 was raw, no need to convert to raw {{(pid=83863) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 28 19:19:48 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:SELECT=34,cinder:UPDATE=34,cinder:INSERT=4 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 19:19:48 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:SELECT=37,cinder:UPDATE=34,cinder:INSERT=13,cinder:DELETE=4 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 19:19:52 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [req-7407e6b2-ebe8-49e5-aace-28e47f165e2e req-f039bc9e-701f-4b72-abc6-cd6e7dfe7149 tempest-VolumesGetTestJSON-1753492701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:19:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-7407e6b2-ebe8-49e5-aace-28e47f165e2e req-f039bc9e-701f-4b72-abc6-cd6e7dfe7149 tempest-VolumesGetTestJSON-1753492701 None] Flow 'volume_create_manager' (c11a3ed6-0cc4-4e89-9dca-351ca23743bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:19:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-7407e6b2-ebe8-49e5-aace-28e47f165e2e req-f039bc9e-701f-4b72-abc6-cd6e7dfe7149 tempest-VolumesGetTestJSON-1753492701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edab870b-b1ef-422b-a8df-04ce996239a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:19:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-7407e6b2-ebe8-49e5-aace-28e47f165e2e req-f039bc9e-701f-4b72-abc6-cd6e7dfe7149 tempest-VolumesGetTestJSON-1753492701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edab870b-b1ef-422b-a8df-04ce996239a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1594363966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8aca27a-6cc6-46c2-8e49-a6cade2f279e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='34e5b07c1c0a4830a1fdea6687b979d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:19:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:19:52Z,use_quota=True,user_id='626ba9ca17a94185a64c897b92d01968',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:19:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-7407e6b2-ebe8-49e5-aace-28e47f165e2e req-f039bc9e-701f-4b72-abc6-cd6e7dfe7149 tempest-VolumesGetTestJSON-1753492701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e84b25a-90a8-4957-a0fd-02fe52c5a8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:19:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-7407e6b2-ebe8-49e5-aace-28e47f165e2e req-f039bc9e-701f-4b72-abc6-cd6e7dfe7149 tempest-VolumesGetTestJSON-1753492701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e84b25a-90a8-4957-a0fd-02fe52c5a8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:19:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-7407e6b2-ebe8-49e5-aace-28e47f165e2e req-f039bc9e-701f-4b72-abc6-cd6e7dfe7149 tempest-VolumesGetTestJSON-1753492701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e60b87e-9ea5-4ee8-bf0c-2afa089a6116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:19:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-7407e6b2-ebe8-49e5-aace-28e47f165e2e req-f039bc9e-701f-4b72-abc6-cd6e7dfe7149 tempest-VolumesGetTestJSON-1753492701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e60b87e-9ea5-4ee8-bf0c-2afa089a6116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8aca27a-6cc6-46c2-8e49-a6cade2f279e', 'volume_name': 'volume-c8aca27a-6cc6-46c2-8e49-a6cade2f279e', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:19:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-7407e6b2-ebe8-49e5-aace-28e47f165e2e req-f039bc9e-701f-4b72-abc6-cd6e7dfe7149 tempest-VolumesGetTestJSON-1753492701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a3cdf82-a617-4930-addc-96534224b2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:19:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-7407e6b2-ebe8-49e5-aace-28e47f165e2e req-f039bc9e-701f-4b72-abc6-cd6e7dfe7149 tempest-VolumesGetTestJSON-1753492701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a3cdf82-a617-4930-addc-96534224b2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:19:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-7407e6b2-ebe8-49e5-aace-28e47f165e2e req-f039bc9e-701f-4b72-abc6-cd6e7dfe7149 tempest-VolumesGetTestJSON-1753492701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed744199-b6f1-41c7-92d2-dca8a6e1d011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:19:52 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [req-7407e6b2-ebe8-49e5-aace-28e47f165e2e req-f039bc9e-701f-4b72-abc6-cd6e7dfe7149 tempest-VolumesGetTestJSON-1753492701 None] Volume c8aca27a-6cc6-46c2-8e49-a6cade2f279e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8aca27a-6cc6-46c2-8e49-a6cade2f279e', 'volume_size': 1} Apr 28 19:19:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-7407e6b2-ebe8-49e5-aace-28e47f165e2e req-f039bc9e-701f-4b72-abc6-cd6e7dfe7149 tempest-VolumesGetTestJSON-1753492701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:19:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e8f6978f-d96b-4cc1-9ad7-0a2c0ac3c279 tempest-VolumesActionsTest-1633652803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.828s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:19:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e8f6978f-d96b-4cc1-9ad7-0a2c0ac3c279 tempest-VolumesActionsTest-1633652803 None] Uploaded volume to glance image-id: 1c5e4bbf-919e-47a9-bcec-d6184ba1f7a8. {{(pid=83863) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 28 19:19:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7efc33fd-67d4-4728-bf95-1c3d75fe2a79 tempest-VolumesActionsTest-1227654161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.730s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:19:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7efc33fd-67d4-4728-bf95-1c3d75fe2a79 tempest-VolumesActionsTest-1227654161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:19:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-765561114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7138186-9996-4cc3-885b-d2d0d5fd06f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38e8856c75104814bef706d799fcb4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:19:38Z,use_quota=True,user_id='846797cf18734e7abb64f3e0f0e6c573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:19:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-7efc33fd-67d4-4728-bf95-1c3d75fe2a79 tempest-VolumesActionsTest-1227654161 None] Creating volume d7138186-9996-4cc3-885b-d2d0d5fd06f3 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:19:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7efc33fd-67d4-4728-bf95-1c3d75fe2a79 tempest-VolumesActionsTest-1227654161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:19:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7efc33fd-67d4-4728-bf95-1c3d75fe2a79 tempest-VolumesActionsTest-1227654161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:19:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7efc33fd-67d4-4728-bf95-1c3d75fe2a79 tempest-VolumesActionsTest-1227654161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:19:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7efc33fd-67d4-4728-bf95-1c3d75fe2a79 tempest-VolumesActionsTest-1227654161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:19:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7efc33fd-67d4-4728-bf95-1c3d75fe2a79 tempest-VolumesActionsTest-1227654161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:19:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7efc33fd-67d4-4728-bf95-1c3d75fe2a79 tempest-VolumesActionsTest-1227654161 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:19:58 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-7efc33fd-67d4-4728-bf95-1c3d75fe2a79 tempest-VolumesActionsTest-1227654161 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:19:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7efc33fd-67d4-4728-bf95-1c3d75fe2a79 tempest-VolumesActionsTest-1227654161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d7138186-9996-4cc3-885b-d2d0d5fd06f3 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:19:58 devstack sudo[89958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d7138186-9996-4cc3-885b-d2d0d5fd06f3 1073741824 Apr 28 19:19:58 devstack sudo[89958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:19:58 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-e8f6978f-d96b-4cc1-9ad7-0a2c0ac3c279 tempest-VolumesActionsTest-1633652803 None] Copy volume to image completed successfully. Apr 28 19:19:59 devstack sudo[89958]: pam_unix(sudo:session): session closed for user root Apr 28 19:19:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7efc33fd-67d4-4728-bf95-1c3d75fe2a79 tempest-VolumesActionsTest-1227654161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d7138186-9996-4cc3-885b-d2d0d5fd06f3 1073741824" returned: 0 in 0.867s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:19:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7efc33fd-67d4-4728-bf95-1c3d75fe2a79 tempest-VolumesActionsTest-1227654161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d7138186-9996-4cc3-885b-d2d0d5fd06f3 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:19:59 devstack sudo[89963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d7138186-9996-4cc3-885b-d2d0d5fd06f3 Apr 28 19:19:59 devstack sudo[89963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:19:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-33a168a8-5ada-4708-b36a-fee9f95d7d81 tempest-VolumesActionsTest-1633652803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:19:59 devstack sudo[89963]: pam_unix(sudo:session): session closed for user root Apr 28 19:19:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7efc33fd-67d4-4728-bf95-1c3d75fe2a79 tempest-VolumesActionsTest-1227654161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d7138186-9996-4cc3-885b-d2d0d5fd06f3" returned: 0 in 0.606s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:19:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7efc33fd-67d4-4728-bf95-1c3d75fe2a79 tempest-VolumesActionsTest-1227654161 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:19:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7efc33fd-67d4-4728-bf95-1c3d75fe2a79 tempest-VolumesActionsTest-1227654161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:19:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-7407e6b2-ebe8-49e5-aace-28e47f165e2e req-f039bc9e-701f-4b72-abc6-cd6e7dfe7149 tempest-VolumesGetTestJSON-1753492701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.385s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:19:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-7407e6b2-ebe8-49e5-aace-28e47f165e2e req-f039bc9e-701f-4b72-abc6-cd6e7dfe7149 tempest-VolumesGetTestJSON-1753492701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1594363966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8aca27a-6cc6-46c2-8e49-a6cade2f279e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='34e5b07c1c0a4830a1fdea6687b979d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:19:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:19:52Z,use_quota=True,user_id='626ba9ca17a94185a64c897b92d01968',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:19:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [req-7407e6b2-ebe8-49e5-aace-28e47f165e2e req-f039bc9e-701f-4b72-abc6-cd6e7dfe7149 tempest-VolumesGetTestJSON-1753492701 None] Creating volume c8aca27a-6cc6-46c2-8e49-a6cade2f279e {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:19:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-7407e6b2-ebe8-49e5-aace-28e47f165e2e req-f039bc9e-701f-4b72-abc6-cd6e7dfe7149 tempest-VolumesGetTestJSON-1753492701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:19:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-7407e6b2-ebe8-49e5-aace-28e47f165e2e req-f039bc9e-701f-4b72-abc6-cd6e7dfe7149 tempest-VolumesGetTestJSON-1753492701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:19:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-7407e6b2-ebe8-49e5-aace-28e47f165e2e req-f039bc9e-701f-4b72-abc6-cd6e7dfe7149 tempest-VolumesGetTestJSON-1753492701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:19:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-7407e6b2-ebe8-49e5-aace-28e47f165e2e req-f039bc9e-701f-4b72-abc6-cd6e7dfe7149 tempest-VolumesGetTestJSON-1753492701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:19:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-7407e6b2-ebe8-49e5-aace-28e47f165e2e req-f039bc9e-701f-4b72-abc6-cd6e7dfe7149 tempest-VolumesGetTestJSON-1753492701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:19:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-7407e6b2-ebe8-49e5-aace-28e47f165e2e req-f039bc9e-701f-4b72-abc6-cd6e7dfe7149 tempest-VolumesGetTestJSON-1753492701 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:19:59 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [req-7407e6b2-ebe8-49e5-aace-28e47f165e2e req-f039bc9e-701f-4b72-abc6-cd6e7dfe7149 tempest-VolumesGetTestJSON-1753492701 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:19:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-7407e6b2-ebe8-49e5-aace-28e47f165e2e req-f039bc9e-701f-4b72-abc6-cd6e7dfe7149 tempest-VolumesGetTestJSON-1753492701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c8aca27a-6cc6-46c2-8e49-a6cade2f279e 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:00 devstack sudo[89966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c8aca27a-6cc6-46c2-8e49-a6cade2f279e 1073741824 Apr 28 19:20:00 devstack sudo[89966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7efc33fd-67d4-4728-bf95-1c3d75fe2a79 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (785d996a-0528-440b-a869-3effdbcef977) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7138186-9996-4cc3-885b-d2d0d5fd06f3', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7efc33fd-67d4-4728-bf95-1c3d75fe2a79 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (425bb894-0e66-4669-8568-9d81219e4402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:00 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-7efc33fd-67d4-4728-bf95-1c3d75fe2a79 tempest-VolumesActionsTest-1227654161 None] Volume volume-d7138186-9996-4cc3-885b-d2d0d5fd06f3 (d7138186-9996-4cc3-885b-d2d0d5fd06f3): created successfully Apr 28 19:20:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7efc33fd-67d4-4728-bf95-1c3d75fe2a79 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (425bb894-0e66-4669-8568-9d81219e4402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7efc33fd-67d4-4728-bf95-1c3d75fe2a79 tempest-VolumesActionsTest-1227654161 None] Flow 'volume_create_manager' (c84b4024-a084-477e-9f74-a5baafe2bae6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:20:00 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-7efc33fd-67d4-4728-bf95-1c3d75fe2a79 tempest-VolumesActionsTest-1227654161 None] Created volume successfully. Apr 28 19:20:00 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-87de5009-8b75-42b3-b117-62917e54675b tempest-VolumesActionsTest-2078684481 None] Acquiring lock "cinder-d7138186-9996-4cc3-885b-d2d0d5fd06f3-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:20:00 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-87de5009-8b75-42b3-b117-62917e54675b tempest-VolumesActionsTest-2078684481 None] Lock "cinder-d7138186-9996-4cc3-885b-d2d0d5fd06f3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:20:00 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-87de5009-8b75-42b3-b117-62917e54675b tempest-VolumesActionsTest-2078684481 None] Acquiring lock "cinder-quobyte-d7138186-9996-4cc3-885b-d2d0d5fd06f3" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:20:00 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-87de5009-8b75-42b3-b117-62917e54675b tempest-VolumesActionsTest-2078684481 None] Lock "cinder-quobyte-d7138186-9996-4cc3-885b-d2d0d5fd06f3" acquired by "delete_volume" :: waited 0.021s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:20:00 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6637a1-f662-47bf-afb8-99cc46a93ce7]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:20:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-87de5009-8b75-42b3-b117-62917e54675b tempest-VolumesActionsTest-2078684481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d7138186-9996-4cc3-885b-d2d0d5fd06f3 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:00 devstack sudo[89968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d7138186-9996-4cc3-885b-d2d0d5fd06f3 Apr 28 19:20:00 devstack sudo[89968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:00 devstack sudo[89966]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-7407e6b2-ebe8-49e5-aace-28e47f165e2e req-f039bc9e-701f-4b72-abc6-cd6e7dfe7149 tempest-VolumesGetTestJSON-1753492701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c8aca27a-6cc6-46c2-8e49-a6cade2f279e 1073741824" returned: 0 in 0.861s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-7407e6b2-ebe8-49e5-aace-28e47f165e2e req-f039bc9e-701f-4b72-abc6-cd6e7dfe7149 tempest-VolumesGetTestJSON-1753492701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c8aca27a-6cc6-46c2-8e49-a6cade2f279e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:00 devstack sudo[89974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c8aca27a-6cc6-46c2-8e49-a6cade2f279e Apr 28 19:20:00 devstack sudo[89974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:01 devstack sudo[89968]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-87de5009-8b75-42b3-b117-62917e54675b tempest-VolumesActionsTest-2078684481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d7138186-9996-4cc3-885b-d2d0d5fd06f3" returned: 0 in 0.761s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-87de5009-8b75-42b3-b117-62917e54675b tempest-VolumesActionsTest-2078684481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d7138186-9996-4cc3-885b-d2d0d5fd06f3 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:01 devstack sudo[89979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d7138186-9996-4cc3-885b-d2d0d5fd06f3 Apr 28 19:20:01 devstack sudo[89979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:01 devstack sudo[89974]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-7407e6b2-ebe8-49e5-aace-28e47f165e2e req-f039bc9e-701f-4b72-abc6-cd6e7dfe7149 tempest-VolumesGetTestJSON-1753492701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c8aca27a-6cc6-46c2-8e49-a6cade2f279e" returned: 0 in 0.623s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:01 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-7407e6b2-ebe8-49e5-aace-28e47f165e2e req-f039bc9e-701f-4b72-abc6-cd6e7dfe7149 tempest-VolumesGetTestJSON-1753492701 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:20:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-7407e6b2-ebe8-49e5-aace-28e47f165e2e req-f039bc9e-701f-4b72-abc6-cd6e7dfe7149 tempest-VolumesGetTestJSON-1753492701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:20:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-33a168a8-5ada-4708-b36a-fee9f95d7d81 tempest-VolumesActionsTest-1633652803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.778s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:20:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-7407e6b2-ebe8-49e5-aace-28e47f165e2e req-f039bc9e-701f-4b72-abc6-cd6e7dfe7149 tempest-VolumesGetTestJSON-1753492701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed744199-b6f1-41c7-92d2-dca8a6e1d011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8aca27a-6cc6-46c2-8e49-a6cade2f279e', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-7407e6b2-ebe8-49e5-aace-28e47f165e2e req-f039bc9e-701f-4b72-abc6-cd6e7dfe7149 tempest-VolumesGetTestJSON-1753492701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe544559-2353-4ce6-b5d8-af87c67c0c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:01 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb41eb4-1f3e-4432-8bb7-48ba2d8bcb01]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:20:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-33a168a8-5ada-4708-b36a-fee9f95d7d81 tempest-VolumesActionsTest-1633652803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-46bdb193-8d43-49c3-9436-8cfb496d6c54 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:01 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [req-7407e6b2-ebe8-49e5-aace-28e47f165e2e req-f039bc9e-701f-4b72-abc6-cd6e7dfe7149 tempest-VolumesGetTestJSON-1753492701 None] Volume volume-c8aca27a-6cc6-46c2-8e49-a6cade2f279e (c8aca27a-6cc6-46c2-8e49-a6cade2f279e): created successfully Apr 28 19:20:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-7407e6b2-ebe8-49e5-aace-28e47f165e2e req-f039bc9e-701f-4b72-abc6-cd6e7dfe7149 tempest-VolumesGetTestJSON-1753492701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe544559-2353-4ce6-b5d8-af87c67c0c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-7407e6b2-ebe8-49e5-aace-28e47f165e2e req-f039bc9e-701f-4b72-abc6-cd6e7dfe7149 tempest-VolumesGetTestJSON-1753492701 None] Flow 'volume_create_manager' (c11a3ed6-0cc4-4e89-9dca-351ca23743bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:20:01 devstack cinder-volume[83863]: INFO cinder.volume.manager [req-7407e6b2-ebe8-49e5-aace-28e47f165e2e req-f039bc9e-701f-4b72-abc6-cd6e7dfe7149 tempest-VolumesGetTestJSON-1753492701 None] Created volume successfully. Apr 28 19:20:01 devstack sudo[89982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-46bdb193-8d43-49c3-9436-8cfb496d6c54 Apr 28 19:20:01 devstack sudo[89982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:01 devstack sudo[89979]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-87de5009-8b75-42b3-b117-62917e54675b tempest-VolumesActionsTest-2078684481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d7138186-9996-4cc3-885b-d2d0d5fd06f3" returned: 0 in 0.599s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:01 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-87de5009-8b75-42b3-b117-62917e54675b tempest-VolumesActionsTest-2078684481 None] Lock "cinder-quobyte-d7138186-9996-4cc3-885b-d2d0d5fd06f3" released by "delete_volume" :: held 1.406s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:20:01 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-87de5009-8b75-42b3-b117-62917e54675b tempest-VolumesActionsTest-2078684481 None] Created reservations ['f25ec1c1-2d23-47e2-bfca-6010edab84e0', '3715eabb-d3ff-45b9-a739-986a5a9b3da8', 'b9cdfc69-d90b-4481-a172-e37ad0ea3ebd', '45ad0925-0eea-4614-b756-b3eea32e4730'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:20:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-87de5009-8b75-42b3-b117-62917e54675b tempest-VolumesActionsTest-2078684481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:20:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-87de5009-8b75-42b3-b117-62917e54675b tempest-VolumesActionsTest-2078684481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:20:01 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-87de5009-8b75-42b3-b117-62917e54675b tempest-VolumesActionsTest-2078684481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:20:01 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-87de5009-8b75-42b3-b117-62917e54675b tempest-VolumesActionsTest-2078684481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:20:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-87de5009-8b75-42b3-b117-62917e54675b tempest-VolumesActionsTest-2078684481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:20:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-87de5009-8b75-42b3-b117-62917e54675b tempest-VolumesActionsTest-2078684481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:01 devstack sudo[89985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:20:01 devstack sudo[89985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:02 devstack sudo[89982]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-33a168a8-5ada-4708-b36a-fee9f95d7d81 tempest-VolumesActionsTest-1633652803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-46bdb193-8d43-49c3-9436-8cfb496d6c54" returned: 0 in 0.756s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:02 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84b8742-b38a-4e49-9176-43e22931fe49]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:20:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-33a168a8-5ada-4708-b36a-fee9f95d7d81 tempest-VolumesActionsTest-1633652803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-46bdb193-8d43-49c3-9436-8cfb496d6c54 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:02 devstack sudo[89990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-46bdb193-8d43-49c3-9436-8cfb496d6c54 Apr 28 19:20:02 devstack sudo[89990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:02 devstack sudo[89985]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:02 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-22f2f62b-4321-4aa5-82e0-6995772a59dd req-97d5f6e2-4fa8-41ef-a249-4f3f352d2fbd tempest-VolumesGetTestJSON-1753492701 None] Acquiring lock "cinder-c8aca27a-6cc6-46c2-8e49-a6cade2f279e-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:20:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-87de5009-8b75-42b3-b117-62917e54675b tempest-VolumesActionsTest-2078684481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.720s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:02 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-87de5009-8b75-42b3-b117-62917e54675b tempest-VolumesActionsTest-2078684481 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:20:02 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-87de5009-8b75-42b3-b117-62917e54675b tempest-VolumesActionsTest-2078684481 None] Deleted volume successfully. Apr 28 19:20:02 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-22f2f62b-4321-4aa5-82e0-6995772a59dd req-97d5f6e2-4fa8-41ef-a249-4f3f352d2fbd tempest-VolumesGetTestJSON-1753492701 None] Lock "cinder-c8aca27a-6cc6-46c2-8e49-a6cade2f279e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:20:02 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-87de5009-8b75-42b3-b117-62917e54675b tempest-VolumesActionsTest-2078684481 None] Lock "cinder-d7138186-9996-4cc3-885b-d2d0d5fd06f3-delete_volume" released by "delete_volume" :: held 2.340s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:20:02 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-22f2f62b-4321-4aa5-82e0-6995772a59dd req-97d5f6e2-4fa8-41ef-a249-4f3f352d2fbd tempest-VolumesGetTestJSON-1753492701 None] Acquiring lock "cinder-quobyte-c8aca27a-6cc6-46c2-8e49-a6cade2f279e" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:20:02 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-22f2f62b-4321-4aa5-82e0-6995772a59dd req-97d5f6e2-4fa8-41ef-a249-4f3f352d2fbd tempest-VolumesGetTestJSON-1753492701 None] Lock "cinder-quobyte-c8aca27a-6cc6-46c2-8e49-a6cade2f279e" acquired by "delete_volume" :: waited 0.019s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:20:02 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76687f1-d531-4a80-9478-b8feb79c1b27]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:20:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-22f2f62b-4321-4aa5-82e0-6995772a59dd req-97d5f6e2-4fa8-41ef-a249-4f3f352d2fbd tempest-VolumesGetTestJSON-1753492701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c8aca27a-6cc6-46c2-8e49-a6cade2f279e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:02 devstack sudo[89993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c8aca27a-6cc6-46c2-8e49-a6cade2f279e Apr 28 19:20:02 devstack sudo[89993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:03 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e238851-143a-4a1e-85ee-4ef7037b43a6 tempest-VolumesActionsTest-1227654161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:20:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7e238851-143a-4a1e-85ee-4ef7037b43a6 tempest-VolumesActionsTest-1227654161 None] Flow 'volume_create_manager' (c40524ed-4418-40fe-b823-26806c4a3119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:20:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7e238851-143a-4a1e-85ee-4ef7037b43a6 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (318fc8f6-e8e8-437b-a069-7c0577493634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7e238851-143a-4a1e-85ee-4ef7037b43a6 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (318fc8f6-e8e8-437b-a069-7c0577493634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-387302310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efad35f3-9c0d-4c4d-9d0b-575a985c1eaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38e8856c75104814bef706d799fcb4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:20:03Z,use_quota=True,user_id='846797cf18734e7abb64f3e0f0e6c573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7e238851-143a-4a1e-85ee-4ef7037b43a6 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8704812c-b857-4794-a973-3848e24c349b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7e238851-143a-4a1e-85ee-4ef7037b43a6 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8704812c-b857-4794-a973-3848e24c349b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7e238851-143a-4a1e-85ee-4ef7037b43a6 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1050ffa0-647d-48de-aab6-e07032923975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7e238851-143a-4a1e-85ee-4ef7037b43a6 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1050ffa0-647d-48de-aab6-e07032923975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efad35f3-9c0d-4c4d-9d0b-575a985c1eaf', 'volume_name': 'volume-efad35f3-9c0d-4c4d-9d0b-575a985c1eaf', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7e238851-143a-4a1e-85ee-4ef7037b43a6 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7286f6bc-b409-4d10-ad15-1652b33e68b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7e238851-143a-4a1e-85ee-4ef7037b43a6 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7286f6bc-b409-4d10-ad15-1652b33e68b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7e238851-143a-4a1e-85ee-4ef7037b43a6 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1c50d10-5810-4b5c-9671-6983003c385e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:03 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-7e238851-143a-4a1e-85ee-4ef7037b43a6 tempest-VolumesActionsTest-1227654161 None] Volume efad35f3-9c0d-4c4d-9d0b-575a985c1eaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efad35f3-9c0d-4c4d-9d0b-575a985c1eaf', 'volume_size': 1} Apr 28 19:20:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7e238851-143a-4a1e-85ee-4ef7037b43a6 tempest-VolumesActionsTest-1227654161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:20:03 devstack sudo[89990]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-33a168a8-5ada-4708-b36a-fee9f95d7d81 tempest-VolumesActionsTest-1633652803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-46bdb193-8d43-49c3-9436-8cfb496d6c54" returned: 0 in 0.897s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-33a168a8-5ada-4708-b36a-fee9f95d7d81 tempest-VolumesActionsTest-1633652803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-46bdb193-8d43-49c3-9436-8cfb496d6c54 /opt/stack/data/cinder/conversion/46bdb193-8d43-49c3-9436-8cfb496d6c54.temp_image.113f6e4c-bd9a-4c92-bbeb-64f5cb737a4ffy3oreu9.img {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:03 devstack sudo[89998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-46bdb193-8d43-49c3-9436-8cfb496d6c54 /opt/stack/data/cinder/conversion/46bdb193-8d43-49c3-9436-8cfb496d6c54.temp_image.113f6e4c-bd9a-4c92-bbeb-64f5cb737a4ffy3oreu9.img Apr 28 19:20:03 devstack sudo[89998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:03 devstack cinder-volume[83863]: DEBUG oslo_service.periodic_task [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 28 19:20:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:20:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:20:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:20:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:20:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:20:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:03 devstack sudo[90003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:20:03 devstack sudo[90003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:03 devstack sudo[89993]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-22f2f62b-4321-4aa5-82e0-6995772a59dd req-97d5f6e2-4fa8-41ef-a249-4f3f352d2fbd tempest-VolumesGetTestJSON-1753492701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c8aca27a-6cc6-46c2-8e49-a6cade2f279e" returned: 0 in 0.760s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-22f2f62b-4321-4aa5-82e0-6995772a59dd req-97d5f6e2-4fa8-41ef-a249-4f3f352d2fbd tempest-VolumesGetTestJSON-1753492701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c8aca27a-6cc6-46c2-8e49-a6cade2f279e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:03 devstack sudo[90005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c8aca27a-6cc6-46c2-8e49-a6cade2f279e Apr 28 19:20:03 devstack sudo[90005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:04 devstack sudo[90005]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-22f2f62b-4321-4aa5-82e0-6995772a59dd req-97d5f6e2-4fa8-41ef-a249-4f3f352d2fbd tempest-VolumesGetTestJSON-1753492701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c8aca27a-6cc6-46c2-8e49-a6cade2f279e" returned: 0 in 1.187s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:04 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-22f2f62b-4321-4aa5-82e0-6995772a59dd req-97d5f6e2-4fa8-41ef-a249-4f3f352d2fbd tempest-VolumesGetTestJSON-1753492701 None] Lock "cinder-quobyte-c8aca27a-6cc6-46c2-8e49-a6cade2f279e" released by "delete_volume" :: held 2.017s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:20:04 devstack cinder-volume[83863]: DEBUG cinder.quota [req-22f2f62b-4321-4aa5-82e0-6995772a59dd req-97d5f6e2-4fa8-41ef-a249-4f3f352d2fbd tempest-VolumesGetTestJSON-1753492701 None] Created reservations ['7626794a-b10c-4d26-acba-2671952d465d', '693fd1eb-1e41-4bfb-ae44-147647c91307', '709dd5fe-5a00-4b58-aac2-07ac01c26c6d', '4e1b8dbf-ca29-4d2f-9758-a4c98f41476a'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:20:04 devstack sudo[90003]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 1.587s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:04 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:20:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-22f2f62b-4321-4aa5-82e0-6995772a59dd req-97d5f6e2-4fa8-41ef-a249-4f3f352d2fbd tempest-VolumesGetTestJSON-1753492701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:20:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-22f2f62b-4321-4aa5-82e0-6995772a59dd req-97d5f6e2-4fa8-41ef-a249-4f3f352d2fbd tempest-VolumesGetTestJSON-1753492701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:20:05 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-22f2f62b-4321-4aa5-82e0-6995772a59dd req-97d5f6e2-4fa8-41ef-a249-4f3f352d2fbd tempest-VolumesGetTestJSON-1753492701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:20:05 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-22f2f62b-4321-4aa5-82e0-6995772a59dd req-97d5f6e2-4fa8-41ef-a249-4f3f352d2fbd tempest-VolumesGetTestJSON-1753492701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:20:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-22f2f62b-4321-4aa5-82e0-6995772a59dd req-97d5f6e2-4fa8-41ef-a249-4f3f352d2fbd tempest-VolumesGetTestJSON-1753492701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:20:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-22f2f62b-4321-4aa5-82e0-6995772a59dd req-97d5f6e2-4fa8-41ef-a249-4f3f352d2fbd tempest-VolumesGetTestJSON-1753492701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:05 devstack sudo[90020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:20:05 devstack sudo[90020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:06 devstack sudo[90020]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-22f2f62b-4321-4aa5-82e0-6995772a59dd req-97d5f6e2-4fa8-41ef-a249-4f3f352d2fbd tempest-VolumesGetTestJSON-1753492701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 1.262s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:06 devstack cinder-volume[83863]: DEBUG cinder.manager [req-22f2f62b-4321-4aa5-82e0-6995772a59dd req-97d5f6e2-4fa8-41ef-a249-4f3f352d2fbd tempest-VolumesGetTestJSON-1753492701 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:20:06 devstack cinder-volume[83863]: INFO cinder.volume.manager [req-22f2f62b-4321-4aa5-82e0-6995772a59dd req-97d5f6e2-4fa8-41ef-a249-4f3f352d2fbd tempest-VolumesGetTestJSON-1753492701 None] Deleted volume successfully. Apr 28 19:20:06 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-22f2f62b-4321-4aa5-82e0-6995772a59dd req-97d5f6e2-4fa8-41ef-a249-4f3f352d2fbd tempest-VolumesGetTestJSON-1753492701 None] Lock "cinder-c8aca27a-6cc6-46c2-8e49-a6cade2f279e-delete_volume" released by "delete_volume" :: held 3.871s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:20:08 devstack sudo[89998]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-33a168a8-5ada-4708-b36a-fee9f95d7d81 tempest-VolumesActionsTest-1633652803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-46bdb193-8d43-49c3-9436-8cfb496d6c54 /opt/stack/data/cinder/conversion/46bdb193-8d43-49c3-9436-8cfb496d6c54.temp_image.113f6e4c-bd9a-4c92-bbeb-64f5cb737a4ffy3oreu9.img" returned: 0 in 5.282s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:08 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8ca294-c4df-40ee-9767-44ed3c3b0504]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:20:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-33a168a8-5ada-4708-b36a-fee9f95d7d81 tempest-VolumesActionsTest-1633652803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-46bdb193-8d43-49c3-9436-8cfb496d6c54 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:08 devstack sudo[90023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-46bdb193-8d43-49c3-9436-8cfb496d6c54 Apr 28 19:20:08 devstack sudo[90023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:09 devstack sudo[90023]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-33a168a8-5ada-4708-b36a-fee9f95d7d81 tempest-VolumesActionsTest-1633652803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-46bdb193-8d43-49c3-9436-8cfb496d6c54" returned: 0 in 0.971s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:09 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-33a168a8-5ada-4708-b36a-fee9f95d7d81 tempest-VolumesActionsTest-1633652803 None] Image conversion details: src /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-46bdb193-8d43-49c3-9436-8cfb496d6c54, size 1024.00 MB, duration 5.28 sec, destination /opt/stack/data/cinder/conversion/46bdb193-8d43-49c3-9436-8cfb496d6c54.temp_image.113f6e4c-bd9a-4c92-bbeb-64f5cb737a4ffy3oreu9.img {{(pid=83863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 19:20:09 devstack cinder-volume[83863]: INFO cinder.image.image_utils [None req-33a168a8-5ada-4708-b36a-fee9f95d7d81 tempest-VolumesActionsTest-1633652803 None] Converted 1024.00 MB image at 193.81 MB/s Apr 28 19:20:09 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-33a168a8-5ada-4708-b36a-fee9f95d7d81 tempest-VolumesActionsTest-1633652803 None] 113f6e4c-bd9a-4c92-bbeb-64f5cb737a4f was raw, converting to qcow2 {{(pid=83863) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 28 19:20:09 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1961978c-1bde-4a44-b899-976efe751240]: (4, 'raw') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:20:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-33a168a8-5ada-4708-b36a-fee9f95d7d81 tempest-VolumesActionsTest-1633652803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/46bdb193-8d43-49c3-9436-8cfb496d6c54.temp_image.113f6e4c-bd9a-4c92-bbeb-64f5cb737a4ffy3oreu9.img {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:09 devstack sudo[90029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/46bdb193-8d43-49c3-9436-8cfb496d6c54.temp_image.113f6e4c-bd9a-4c92-bbeb-64f5cb737a4ffy3oreu9.img Apr 28 19:20:09 devstack sudo[90029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:10 devstack sudo[90029]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-33a168a8-5ada-4708-b36a-fee9f95d7d81 tempest-VolumesActionsTest-1633652803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/46bdb193-8d43-49c3-9436-8cfb496d6c54.temp_image.113f6e4c-bd9a-4c92-bbeb-64f5cb737a4ffy3oreu9.img" returned: 0 in 0.702s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-33a168a8-5ada-4708-b36a-fee9f95d7d81 tempest-VolumesActionsTest-1633652803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/46bdb193-8d43-49c3-9436-8cfb496d6c54.temp_image.113f6e4c-bd9a-4c92-bbeb-64f5cb737a4ffy3oreu9.img {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:10 devstack sudo[90033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/46bdb193-8d43-49c3-9436-8cfb496d6c54.temp_image.113f6e4c-bd9a-4c92-bbeb-64f5cb737a4ffy3oreu9.img Apr 28 19:20:10 devstack sudo[90033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:10 devstack sudo[90033]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-33a168a8-5ada-4708-b36a-fee9f95d7d81 tempest-VolumesActionsTest-1633652803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/46bdb193-8d43-49c3-9436-8cfb496d6c54.temp_image.113f6e4c-bd9a-4c92-bbeb-64f5cb737a4ffy3oreu9.img" returned: 1 in 0.721s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-33a168a8-5ada-4708-b36a-fee9f95d7d81 tempest-VolumesActionsTest-1633652803 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/46bdb193-8d43-49c3-9436-8cfb496d6c54.temp_image.113f6e4c-bd9a-4c92-bbeb-64f5cb737a4ffy3oreu9.img' failed. Not Retrying. {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 19:20:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-33a168a8-5ada-4708-b36a-fee9f95d7d81 tempest-VolumesActionsTest-1633652803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/46bdb193-8d43-49c3-9436-8cfb496d6c54.temp_image.113f6e4c-bd9a-4c92-bbeb-64f5cb737a4ffy3oreu9.img /opt/stack/data/cinder/conversion/vol_upload_10h0fbpc {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:10 devstack sudo[90039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/46bdb193-8d43-49c3-9436-8cfb496d6c54.temp_image.113f6e4c-bd9a-4c92-bbeb-64f5cb737a4ffy3oreu9.img /opt/stack/data/cinder/conversion/vol_upload_10h0fbpc Apr 28 19:20:10 devstack sudo[90039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:11 devstack sudo[90039]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-33a168a8-5ada-4708-b36a-fee9f95d7d81 tempest-VolumesActionsTest-1633652803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/46bdb193-8d43-49c3-9436-8cfb496d6c54.temp_image.113f6e4c-bd9a-4c92-bbeb-64f5cb737a4ffy3oreu9.img /opt/stack/data/cinder/conversion/vol_upload_10h0fbpc" returned: 0 in 0.777s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:11 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-33a168a8-5ada-4708-b36a-fee9f95d7d81 tempest-VolumesActionsTest-1633652803 None] Image conversion details: src /opt/stack/data/cinder/conversion/46bdb193-8d43-49c3-9436-8cfb496d6c54.temp_image.113f6e4c-bd9a-4c92-bbeb-64f5cb737a4ffy3oreu9.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_10h0fbpc {{(pid=83863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 19:20:11 devstack cinder-volume[83863]: INFO cinder.image.image_utils [None req-33a168a8-5ada-4708-b36a-fee9f95d7d81 tempest-VolumesActionsTest-1633652803 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 28 19:20:11 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00e08ce-04c0-422f-802a-334a00e3c432]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:20:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-33a168a8-5ada-4708-b36a-fee9f95d7d81 tempest-VolumesActionsTest-1633652803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_10h0fbpc {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:11 devstack sudo[90044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_10h0fbpc Apr 28 19:20:11 devstack sudo[90044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:12 devstack sudo[90044]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-33a168a8-5ada-4708-b36a-fee9f95d7d81 tempest-VolumesActionsTest-1633652803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_10h0fbpc" returned: 0 in 0.738s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-33a168a8-5ada-4708-b36a-fee9f95d7d81 tempest-VolumesActionsTest-1633652803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.431s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:20:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-33a168a8-5ada-4708-b36a-fee9f95d7d81 tempest-VolumesActionsTest-1633652803 None] Uploaded volume to glance image-id: 113f6e4c-bd9a-4c92-bbeb-64f5cb737a4f. {{(pid=83863) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 28 19:20:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7e238851-143a-4a1e-85ee-4ef7037b43a6 tempest-VolumesActionsTest-1227654161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.745s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:20:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7e238851-143a-4a1e-85ee-4ef7037b43a6 tempest-VolumesActionsTest-1227654161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-387302310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efad35f3-9c0d-4c4d-9d0b-575a985c1eaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38e8856c75104814bef706d799fcb4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:20:03Z,use_quota=True,user_id='846797cf18734e7abb64f3e0f0e6c573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:20:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-7e238851-143a-4a1e-85ee-4ef7037b43a6 tempest-VolumesActionsTest-1227654161 None] Creating volume efad35f3-9c0d-4c4d-9d0b-575a985c1eaf {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:20:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7e238851-143a-4a1e-85ee-4ef7037b43a6 tempest-VolumesActionsTest-1227654161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:20:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7e238851-143a-4a1e-85ee-4ef7037b43a6 tempest-VolumesActionsTest-1227654161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:20:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7e238851-143a-4a1e-85ee-4ef7037b43a6 tempest-VolumesActionsTest-1227654161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:20:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7e238851-143a-4a1e-85ee-4ef7037b43a6 tempest-VolumesActionsTest-1227654161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:20:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7e238851-143a-4a1e-85ee-4ef7037b43a6 tempest-VolumesActionsTest-1227654161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:20:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7e238851-143a-4a1e-85ee-4ef7037b43a6 tempest-VolumesActionsTest-1227654161 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:20:13 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-7e238851-143a-4a1e-85ee-4ef7037b43a6 tempest-VolumesActionsTest-1227654161 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:20:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7e238851-143a-4a1e-85ee-4ef7037b43a6 tempest-VolumesActionsTest-1227654161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-efad35f3-9c0d-4c4d-9d0b-575a985c1eaf 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:13 devstack sudo[90049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-efad35f3-9c0d-4c4d-9d0b-575a985c1eaf 1073741824 Apr 28 19:20:13 devstack sudo[90049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:13 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-33a168a8-5ada-4708-b36a-fee9f95d7d81 tempest-VolumesActionsTest-1633652803 None] Copy volume to image completed successfully. Apr 28 19:20:14 devstack sudo[90049]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7e238851-143a-4a1e-85ee-4ef7037b43a6 tempest-VolumesActionsTest-1227654161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-efad35f3-9c0d-4c4d-9d0b-575a985c1eaf 1073741824" returned: 0 in 0.904s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7e238851-143a-4a1e-85ee-4ef7037b43a6 tempest-VolumesActionsTest-1227654161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-efad35f3-9c0d-4c4d-9d0b-575a985c1eaf {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:14 devstack sudo[90055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-efad35f3-9c0d-4c4d-9d0b-575a985c1eaf Apr 28 19:20:14 devstack sudo[90055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:15 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5098bfbb-1b06-4313-9136-8a4ceab34564 tempest-VolumesActionsTest-1633652803 None] Acquiring lock "cinder-46bdb193-8d43-49c3-9436-8cfb496d6c54-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:20:15 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5098bfbb-1b06-4313-9136-8a4ceab34564 tempest-VolumesActionsTest-1633652803 None] Lock "cinder-46bdb193-8d43-49c3-9436-8cfb496d6c54-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:20:15 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-b1c37a6f-a8e7-44f3-9b21-012b82cfd1fe tempest-GroupSnapshotsTest-2116439637 None] Group tempest-GroupSnapshotsTest-Group-1764437160: creating Apr 28 19:20:15 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5098bfbb-1b06-4313-9136-8a4ceab34564 tempest-VolumesActionsTest-1633652803 None] Acquiring lock "cinder-quobyte-46bdb193-8d43-49c3-9436-8cfb496d6c54" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:20:15 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5098bfbb-1b06-4313-9136-8a4ceab34564 tempest-VolumesActionsTest-1633652803 None] Lock "cinder-quobyte-46bdb193-8d43-49c3-9436-8cfb496d6c54" acquired by "delete_volume" :: waited 0.021s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:20:15 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f667e59-bcf2-43f6-9cd6-4baeb190d0d6]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:20:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5098bfbb-1b06-4313-9136-8a4ceab34564 tempest-VolumesActionsTest-1633652803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-46bdb193-8d43-49c3-9436-8cfb496d6c54 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:15 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-b1c37a6f-a8e7-44f3-9b21-012b82cfd1fe tempest-GroupSnapshotsTest-2116439637 None] Group tempest-GroupSnapshotsTest-Group-1764437160: created successfully Apr 28 19:20:15 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-b1c37a6f-a8e7-44f3-9b21-012b82cfd1fe tempest-GroupSnapshotsTest-2116439637 None] Create group completed successfully. Apr 28 19:20:15 devstack sudo[90057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-46bdb193-8d43-49c3-9436-8cfb496d6c54 Apr 28 19:20:15 devstack sudo[90057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:15 devstack sudo[90055]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7e238851-143a-4a1e-85ee-4ef7037b43a6 tempest-VolumesActionsTest-1227654161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-efad35f3-9c0d-4c4d-9d0b-575a985c1eaf" returned: 0 in 0.755s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:15 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7e238851-143a-4a1e-85ee-4ef7037b43a6 tempest-VolumesActionsTest-1227654161 None] <== create_volume: return (1720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:20:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7e238851-143a-4a1e-85ee-4ef7037b43a6 tempest-VolumesActionsTest-1227654161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.723s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:20:15 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7e238851-143a-4a1e-85ee-4ef7037b43a6 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1c50d10-5810-4b5c-9671-6983003c385e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efad35f3-9c0d-4c4d-9d0b-575a985c1eaf', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:15 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7e238851-143a-4a1e-85ee-4ef7037b43a6 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60f84f82-84c5-4a51-93db-7f6b0f53c8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:15 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-7e238851-143a-4a1e-85ee-4ef7037b43a6 tempest-VolumesActionsTest-1227654161 None] Volume volume-efad35f3-9c0d-4c4d-9d0b-575a985c1eaf (efad35f3-9c0d-4c4d-9d0b-575a985c1eaf): created successfully Apr 28 19:20:15 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7e238851-143a-4a1e-85ee-4ef7037b43a6 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60f84f82-84c5-4a51-93db-7f6b0f53c8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:15 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7e238851-143a-4a1e-85ee-4ef7037b43a6 tempest-VolumesActionsTest-1227654161 None] Flow 'volume_create_manager' (c40524ed-4418-40fe-b823-26806c4a3119) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:20:15 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-7e238851-143a-4a1e-85ee-4ef7037b43a6 tempest-VolumesActionsTest-1227654161 None] Created volume successfully. Apr 28 19:20:16 devstack sudo[90057]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5098bfbb-1b06-4313-9136-8a4ceab34564 tempest-VolumesActionsTest-1633652803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-46bdb193-8d43-49c3-9436-8cfb496d6c54" returned: 0 in 0.725s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5098bfbb-1b06-4313-9136-8a4ceab34564 tempest-VolumesActionsTest-1633652803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-46bdb193-8d43-49c3-9436-8cfb496d6c54 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:16 devstack sudo[90063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-46bdb193-8d43-49c3-9436-8cfb496d6c54 Apr 28 19:20:16 devstack sudo[90063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:16 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9d1e88b1-cfff-4c89-98de-69125353c16d tempest-VolumesActionsTest-2078684481 None] Acquiring lock "cinder-efad35f3-9c0d-4c4d-9d0b-575a985c1eaf-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:20:16 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9d1e88b1-cfff-4c89-98de-69125353c16d tempest-VolumesActionsTest-2078684481 None] Lock "cinder-efad35f3-9c0d-4c4d-9d0b-575a985c1eaf-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:20:16 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9d1e88b1-cfff-4c89-98de-69125353c16d tempest-VolumesActionsTest-2078684481 None] Acquiring lock "cinder-quobyte-efad35f3-9c0d-4c4d-9d0b-575a985c1eaf" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:20:16 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9d1e88b1-cfff-4c89-98de-69125353c16d tempest-VolumesActionsTest-2078684481 None] Lock "cinder-quobyte-efad35f3-9c0d-4c4d-9d0b-575a985c1eaf" acquired by "delete_volume" :: waited 0.016s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:20:16 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ca4490-5c78-43b7-b421-1717554eec12]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:20:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9d1e88b1-cfff-4c89-98de-69125353c16d tempest-VolumesActionsTest-2078684481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-efad35f3-9c0d-4c4d-9d0b-575a985c1eaf {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:16 devstack sudo[90063]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5098bfbb-1b06-4313-9136-8a4ceab34564 tempest-VolumesActionsTest-1633652803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-46bdb193-8d43-49c3-9436-8cfb496d6c54" returned: 0 in 0.654s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:16 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5098bfbb-1b06-4313-9136-8a4ceab34564 tempest-VolumesActionsTest-1633652803 None] Lock "cinder-quobyte-46bdb193-8d43-49c3-9436-8cfb496d6c54" released by "delete_volume" :: held 1.432s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:20:16 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-5098bfbb-1b06-4313-9136-8a4ceab34564 tempest-VolumesActionsTest-1633652803 None] Created reservations ['456ba88e-8d26-4479-9ca3-46d9d14c6f58', 'fac4bb76-892e-4567-a56d-7faa9093cf3a', 'db9de05f-dc05-40a9-891d-f07ec7f90ba9', '09bbff98-f4c5-4757-b3ac-146b1c573bda'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:20:16 devstack sudo[90066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-efad35f3-9c0d-4c4d-9d0b-575a985c1eaf Apr 28 19:20:16 devstack sudo[90066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5098bfbb-1b06-4313-9136-8a4ceab34564 tempest-VolumesActionsTest-1633652803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:20:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5098bfbb-1b06-4313-9136-8a4ceab34564 tempest-VolumesActionsTest-1633652803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:20:16 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5098bfbb-1b06-4313-9136-8a4ceab34564 tempest-VolumesActionsTest-1633652803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:20:16 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5098bfbb-1b06-4313-9136-8a4ceab34564 tempest-VolumesActionsTest-1633652803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:20:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5098bfbb-1b06-4313-9136-8a4ceab34564 tempest-VolumesActionsTest-1633652803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:20:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5098bfbb-1b06-4313-9136-8a4ceab34564 tempest-VolumesActionsTest-1633652803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:16 devstack sudo[90068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:20:16 devstack sudo[90068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:17 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-8095b5be-d6e5-4bb8-8de8-539ce87a0734 tempest-GroupSnapshotsTest-2116439637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:20:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-8095b5be-d6e5-4bb8-8de8-539ce87a0734 tempest-GroupSnapshotsTest-2116439637 None] Flow 'volume_create_manager' (282f4a5c-841d-4850-95fd-436fb9ba96df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:20:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-8095b5be-d6e5-4bb8-8de8-539ce87a0734 tempest-GroupSnapshotsTest-2116439637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc889b1c-0c0d-4904-bab9-362c08f368f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-8095b5be-d6e5-4bb8-8de8-539ce87a0734 tempest-GroupSnapshotsTest-2116439637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc889b1c-0c0d-4904-bab9-362c08f368f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2023664688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5c727277-fa78-48cb-ac65-1e0a318f1a30,host='devstack@QuobyteHD#QuobyteHD',id=fa9c9017-ed4c-4025-b87b-148737ffa45b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e401e9fc3544a1d944049a2dd4e5750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:20:17Z,use_quota=True,user_id='f9e5c409ae3c4e69a21e97e35ff5de19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(823b5f6f-7f6a-49b2-bff8-e5ce6dc1ce35),volume_type_id=823b5f6f-7f6a-49b2-bff8-e5ce6dc1ce35)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-8095b5be-d6e5-4bb8-8de8-539ce87a0734 tempest-GroupSnapshotsTest-2116439637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a4f2b7f-cb43-4e69-90a2-3354c4a215f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-8095b5be-d6e5-4bb8-8de8-539ce87a0734 tempest-GroupSnapshotsTest-2116439637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a4f2b7f-cb43-4e69-90a2-3354c4a215f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-8095b5be-d6e5-4bb8-8de8-539ce87a0734 tempest-GroupSnapshotsTest-2116439637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9493207e-9173-47b9-acb3-3d702c52a56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-8095b5be-d6e5-4bb8-8de8-539ce87a0734 tempest-GroupSnapshotsTest-2116439637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9493207e-9173-47b9-acb3-3d702c52a56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa9c9017-ed4c-4025-b87b-148737ffa45b', 'volume_name': 'volume-fa9c9017-ed4c-4025-b87b-148737ffa45b', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-8095b5be-d6e5-4bb8-8de8-539ce87a0734 tempest-GroupSnapshotsTest-2116439637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c1faf87-ce7d-4c9c-8b39-60896f7200f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-8095b5be-d6e5-4bb8-8de8-539ce87a0734 tempest-GroupSnapshotsTest-2116439637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c1faf87-ce7d-4c9c-8b39-60896f7200f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-8095b5be-d6e5-4bb8-8de8-539ce87a0734 tempest-GroupSnapshotsTest-2116439637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fd69e8c-8daf-4635-8dac-d80a4c524e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:17 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-8095b5be-d6e5-4bb8-8de8-539ce87a0734 tempest-GroupSnapshotsTest-2116439637 None] Volume fa9c9017-ed4c-4025-b87b-148737ffa45b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa9c9017-ed4c-4025-b87b-148737ffa45b', 'volume_size': 1} Apr 28 19:20:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8095b5be-d6e5-4bb8-8de8-539ce87a0734 tempest-GroupSnapshotsTest-2116439637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:20:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8095b5be-d6e5-4bb8-8de8-539ce87a0734 tempest-GroupSnapshotsTest-2116439637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:20:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-8095b5be-d6e5-4bb8-8de8-539ce87a0734 tempest-GroupSnapshotsTest-2116439637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5c727277-fa78-48cb-ac65-1e0a318f1a30,created_at=2026-04-28T17:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2023664688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5c727277-fa78-48cb-ac65-1e0a318f1a30,host='devstack@QuobyteHD#QuobyteHD',id=fa9c9017-ed4c-4025-b87b-148737ffa45b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e401e9fc3544a1d944049a2dd4e5750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:20:17Z,use_quota=True,user_id='f9e5c409ae3c4e69a21e97e35ff5de19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(823b5f6f-7f6a-49b2-bff8-e5ce6dc1ce35),volume_type_id=823b5f6f-7f6a-49b2-bff8-e5ce6dc1ce35)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:20:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-8095b5be-d6e5-4bb8-8de8-539ce87a0734 tempest-GroupSnapshotsTest-2116439637 None] Creating volume fa9c9017-ed4c-4025-b87b-148737ffa45b {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:20:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8095b5be-d6e5-4bb8-8de8-539ce87a0734 tempest-GroupSnapshotsTest-2116439637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:20:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8095b5be-d6e5-4bb8-8de8-539ce87a0734 tempest-GroupSnapshotsTest-2116439637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:20:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-8095b5be-d6e5-4bb8-8de8-539ce87a0734 tempest-GroupSnapshotsTest-2116439637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:20:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-8095b5be-d6e5-4bb8-8de8-539ce87a0734 tempest-GroupSnapshotsTest-2116439637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:20:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8095b5be-d6e5-4bb8-8de8-539ce87a0734 tempest-GroupSnapshotsTest-2116439637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:20:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-8095b5be-d6e5-4bb8-8de8-539ce87a0734 tempest-GroupSnapshotsTest-2116439637 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:20:17 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-8095b5be-d6e5-4bb8-8de8-539ce87a0734 tempest-GroupSnapshotsTest-2116439637 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:20:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8095b5be-d6e5-4bb8-8de8-539ce87a0734 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:17 devstack sudo[90070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b 1073741824 Apr 28 19:20:17 devstack sudo[90070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:17 devstack sudo[90066]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9d1e88b1-cfff-4c89-98de-69125353c16d tempest-VolumesActionsTest-2078684481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-efad35f3-9c0d-4c4d-9d0b-575a985c1eaf" returned: 0 in 0.795s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9d1e88b1-cfff-4c89-98de-69125353c16d tempest-VolumesActionsTest-2078684481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-efad35f3-9c0d-4c4d-9d0b-575a985c1eaf {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:17 devstack sudo[90077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-efad35f3-9c0d-4c4d-9d0b-575a985c1eaf Apr 28 19:20:17 devstack sudo[90077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:17 devstack sudo[90068]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5098bfbb-1b06-4313-9136-8a4ceab34564 tempest-VolumesActionsTest-1633652803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.693s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:17 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-5098bfbb-1b06-4313-9136-8a4ceab34564 tempest-VolumesActionsTest-1633652803 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:20:17 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-5098bfbb-1b06-4313-9136-8a4ceab34564 tempest-VolumesActionsTest-1633652803 None] Deleted volume successfully. Apr 28 19:20:17 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5098bfbb-1b06-4313-9136-8a4ceab34564 tempest-VolumesActionsTest-1633652803 None] Lock "cinder-46bdb193-8d43-49c3-9436-8cfb496d6c54-delete_volume" released by "delete_volume" :: held 2.458s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:20:17 devstack sudo[90070]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8095b5be-d6e5-4bb8-8de8-539ce87a0734 tempest-GroupSnapshotsTest-2116439637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b 1073741824" returned: 0 in 0.860s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8095b5be-d6e5-4bb8-8de8-539ce87a0734 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:18 devstack sudo[90083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b Apr 28 19:20:18 devstack sudo[90083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:18 devstack sudo[90077]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9d1e88b1-cfff-4c89-98de-69125353c16d tempest-VolumesActionsTest-2078684481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-efad35f3-9c0d-4c4d-9d0b-575a985c1eaf" returned: 0 in 0.709s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:18 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9d1e88b1-cfff-4c89-98de-69125353c16d tempest-VolumesActionsTest-2078684481 None] Lock "cinder-quobyte-efad35f3-9c0d-4c4d-9d0b-575a985c1eaf" released by "delete_volume" :: held 1.576s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:20:18 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-9d1e88b1-cfff-4c89-98de-69125353c16d tempest-VolumesActionsTest-2078684481 None] Created reservations ['8bd5cbc1-6bf1-4063-8703-77c388e4f68c', 'f9338817-8c52-48cd-b896-ec34a3e76761', 'bc006846-b694-4f7e-9f09-f1268d5e8830', 'cc38f805-790a-43e2-99a3-2a5b052f93d2'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:20:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9d1e88b1-cfff-4c89-98de-69125353c16d tempest-VolumesActionsTest-2078684481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:20:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9d1e88b1-cfff-4c89-98de-69125353c16d tempest-VolumesActionsTest-2078684481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:20:18 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-9d1e88b1-cfff-4c89-98de-69125353c16d tempest-VolumesActionsTest-2078684481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:20:18 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-9d1e88b1-cfff-4c89-98de-69125353c16d tempest-VolumesActionsTest-2078684481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:20:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9d1e88b1-cfff-4c89-98de-69125353c16d tempest-VolumesActionsTest-2078684481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:20:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9d1e88b1-cfff-4c89-98de-69125353c16d tempest-VolumesActionsTest-2078684481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:18 devstack sudo[90086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:20:18 devstack sudo[90086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:18 devstack sudo[90083]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8095b5be-d6e5-4bb8-8de8-539ce87a0734 tempest-GroupSnapshotsTest-2116439637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b" returned: 0 in 0.691s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:18 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-8095b5be-d6e5-4bb8-8de8-539ce87a0734 tempest-GroupSnapshotsTest-2116439637 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:20:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8095b5be-d6e5-4bb8-8de8-539ce87a0734 tempest-GroupSnapshotsTest-2116439637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:20:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-8095b5be-d6e5-4bb8-8de8-539ce87a0734 tempest-GroupSnapshotsTest-2116439637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fd69e8c-8daf-4635-8dac-d80a4c524e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa9c9017-ed4c-4025-b87b-148737ffa45b', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-8095b5be-d6e5-4bb8-8de8-539ce87a0734 tempest-GroupSnapshotsTest-2116439637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01df10a2-2689-474d-9e64-86bf1476ae16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:18 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-8095b5be-d6e5-4bb8-8de8-539ce87a0734 tempest-GroupSnapshotsTest-2116439637 None] Volume volume-fa9c9017-ed4c-4025-b87b-148737ffa45b (fa9c9017-ed4c-4025-b87b-148737ffa45b): created successfully Apr 28 19:20:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-8095b5be-d6e5-4bb8-8de8-539ce87a0734 tempest-GroupSnapshotsTest-2116439637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01df10a2-2689-474d-9e64-86bf1476ae16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-8095b5be-d6e5-4bb8-8de8-539ce87a0734 tempest-GroupSnapshotsTest-2116439637 None] Flow 'volume_create_manager' (282f4a5c-841d-4850-95fd-436fb9ba96df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:20:18 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-8095b5be-d6e5-4bb8-8de8-539ce87a0734 tempest-GroupSnapshotsTest-2116439637 None] Created volume successfully. Apr 28 19:20:19 devstack sudo[90086]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9d1e88b1-cfff-4c89-98de-69125353c16d tempest-VolumesActionsTest-2078684481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.720s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:19 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-9d1e88b1-cfff-4c89-98de-69125353c16d tempest-VolumesActionsTest-2078684481 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:20:19 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-9d1e88b1-cfff-4c89-98de-69125353c16d tempest-VolumesActionsTest-2078684481 None] Deleted volume successfully. Apr 28 19:20:19 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9d1e88b1-cfff-4c89-98de-69125353c16d tempest-VolumesActionsTest-2078684481 None] Lock "cinder-efad35f3-9c0d-4c4d-9d0b-575a985c1eaf-delete_volume" released by "delete_volume" :: held 2.542s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:20:19 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-3895a587-18d1-4526-baac-ae61b5ad17b9 tempest-VolumesActionsTest-1227654161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:20:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3895a587-18d1-4526-baac-ae61b5ad17b9 tempest-VolumesActionsTest-1227654161 None] Flow 'volume_create_manager' (4207d3e5-670f-4afd-b9c0-f760adfcad1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:20:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3895a587-18d1-4526-baac-ae61b5ad17b9 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19bc9aef-8b87-44e3-ad6f-040c01bd9b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3895a587-18d1-4526-baac-ae61b5ad17b9 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19bc9aef-8b87-44e3-ad6f-040c01bd9b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1248555832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09f55dbc-c43a-4828-8b21-ce77519e3b1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38e8856c75104814bef706d799fcb4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:20:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:20:19Z,use_quota=True,user_id='846797cf18734e7abb64f3e0f0e6c573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3895a587-18d1-4526-baac-ae61b5ad17b9 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3d1f43f-b5f9-4ef1-8997-0a7bded9b74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3895a587-18d1-4526-baac-ae61b5ad17b9 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3d1f43f-b5f9-4ef1-8997-0a7bded9b74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3895a587-18d1-4526-baac-ae61b5ad17b9 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93a4da0a-f6dd-4d59-9cc6-d9b02413d6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3895a587-18d1-4526-baac-ae61b5ad17b9 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93a4da0a-f6dd-4d59-9cc6-d9b02413d6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09f55dbc-c43a-4828-8b21-ce77519e3b1a', 'volume_name': 'volume-09f55dbc-c43a-4828-8b21-ce77519e3b1a', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3895a587-18d1-4526-baac-ae61b5ad17b9 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28bc3038-3cb7-45bf-b9f8-c1986a5d3052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3895a587-18d1-4526-baac-ae61b5ad17b9 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28bc3038-3cb7-45bf-b9f8-c1986a5d3052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3895a587-18d1-4526-baac-ae61b5ad17b9 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c475f64c-2bd4-424e-8e0e-f3d4d79a851e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:19 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-3895a587-18d1-4526-baac-ae61b5ad17b9 tempest-VolumesActionsTest-1227654161 None] Volume 09f55dbc-c43a-4828-8b21-ce77519e3b1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09f55dbc-c43a-4828-8b21-ce77519e3b1a', 'volume_size': 1} Apr 28 19:20:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3895a587-18d1-4526-baac-ae61b5ad17b9 tempest-VolumesActionsTest-1227654161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:20:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3895a587-18d1-4526-baac-ae61b5ad17b9 tempest-VolumesActionsTest-1227654161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:20:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3895a587-18d1-4526-baac-ae61b5ad17b9 tempest-VolumesActionsTest-1227654161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1248555832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09f55dbc-c43a-4828-8b21-ce77519e3b1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38e8856c75104814bef706d799fcb4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:20:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:20:19Z,use_quota=True,user_id='846797cf18734e7abb64f3e0f0e6c573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:20:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-3895a587-18d1-4526-baac-ae61b5ad17b9 tempest-VolumesActionsTest-1227654161 None] Creating volume 09f55dbc-c43a-4828-8b21-ce77519e3b1a {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:20:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3895a587-18d1-4526-baac-ae61b5ad17b9 tempest-VolumesActionsTest-1227654161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:20:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3895a587-18d1-4526-baac-ae61b5ad17b9 tempest-VolumesActionsTest-1227654161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:20:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3895a587-18d1-4526-baac-ae61b5ad17b9 tempest-VolumesActionsTest-1227654161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:20:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3895a587-18d1-4526-baac-ae61b5ad17b9 tempest-VolumesActionsTest-1227654161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:20:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3895a587-18d1-4526-baac-ae61b5ad17b9 tempest-VolumesActionsTest-1227654161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:20:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3895a587-18d1-4526-baac-ae61b5ad17b9 tempest-VolumesActionsTest-1227654161 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:20:19 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-3895a587-18d1-4526-baac-ae61b5ad17b9 tempest-VolumesActionsTest-1227654161 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:20:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3895a587-18d1-4526-baac-ae61b5ad17b9 tempest-VolumesActionsTest-1227654161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-09f55dbc-c43a-4828-8b21-ce77519e3b1a 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:19 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-3f19a726-41c0-4267-96a4-5c740ef75639 tempest-GroupSnapshotsTest-2116439637 None] GroupSnapshot 9ccfd57b-e351-4b57-b88a-43838a0c7785: creating. Apr 28 19:20:19 devstack sudo[90091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-09f55dbc-c43a-4828-8b21-ce77519e3b1a 1073741824 Apr 28 19:20:19 devstack sudo[90091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3f19a726-41c0-4267-96a4-5c740ef75639 tempest-GroupSnapshotsTest-2116439637 None] Group snapshot 9ccfd57b-e351-4b57-b88a-43838a0c7785: creating. {{(pid=83863) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 28 19:20:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3f19a726-41c0-4267-96a4-5c740ef75639 tempest-GroupSnapshotsTest-2116439637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:20:20 devstack sudo[90091]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3895a587-18d1-4526-baac-ae61b5ad17b9 tempest-VolumesActionsTest-1227654161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-09f55dbc-c43a-4828-8b21-ce77519e3b1a 1073741824" returned: 0 in 0.901s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3895a587-18d1-4526-baac-ae61b5ad17b9 tempest-VolumesActionsTest-1227654161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-09f55dbc-c43a-4828-8b21-ce77519e3b1a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:20 devstack sudo[90097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-09f55dbc-c43a-4828-8b21-ce77519e3b1a Apr 28 19:20:20 devstack sudo[90097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:21 devstack sudo[90097]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3895a587-18d1-4526-baac-ae61b5ad17b9 tempest-VolumesActionsTest-1227654161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-09f55dbc-c43a-4828-8b21-ce77519e3b1a" returned: 0 in 0.663s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:21 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3895a587-18d1-4526-baac-ae61b5ad17b9 tempest-VolumesActionsTest-1227654161 None] <== create_volume: return (1623ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:20:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3895a587-18d1-4526-baac-ae61b5ad17b9 tempest-VolumesActionsTest-1227654161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:20:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3f19a726-41c0-4267-96a4-5c740ef75639 tempest-GroupSnapshotsTest-2116439637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.553s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:20:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3895a587-18d1-4526-baac-ae61b5ad17b9 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c475f64c-2bd4-424e-8e0e-f3d4d79a851e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09f55dbc-c43a-4828-8b21-ce77519e3b1a', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3895a587-18d1-4526-baac-ae61b5ad17b9 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94d764bd-01c5-4f65-b8b7-e1ca407275a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:21 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-3f19a726-41c0-4267-96a4-5c740ef75639 tempest-GroupSnapshotsTest-2116439637 None] Creating offline snapshot 73b92201-0335-4af3-8d9a-f5ed2b0a5911 of volume fa9c9017-ed4c-4025-b87b-148737ffa45b {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 19:20:21 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-3895a587-18d1-4526-baac-ae61b5ad17b9 tempest-VolumesActionsTest-1227654161 None] Volume volume-09f55dbc-c43a-4828-8b21-ce77519e3b1a (09f55dbc-c43a-4828-8b21-ce77519e3b1a): created successfully Apr 28 19:20:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3895a587-18d1-4526-baac-ae61b5ad17b9 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94d764bd-01c5-4f65-b8b7-e1ca407275a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3895a587-18d1-4526-baac-ae61b5ad17b9 tempest-VolumesActionsTest-1227654161 None] Flow 'volume_create_manager' (4207d3e5-670f-4afd-b9c0-f760adfcad1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:20:21 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[744d5bb2-5bc4-4b5c-9a05-167d21b6e7f8]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:20:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3f19a726-41c0-4267-96a4-5c740ef75639 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:21 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-3895a587-18d1-4526-baac-ae61b5ad17b9 tempest-VolumesActionsTest-1227654161 None] Created volume successfully. Apr 28 19:20:21 devstack sudo[90102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b Apr 28 19:20:21 devstack sudo[90102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:21 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9587dcf6-5b78-4479-90a5-d3c8ab5c7167 tempest-VolumesActionsTest-2078684481 None] Acquiring lock "cinder-09f55dbc-c43a-4828-8b21-ce77519e3b1a-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:20:21 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9587dcf6-5b78-4479-90a5-d3c8ab5c7167 tempest-VolumesActionsTest-2078684481 None] Lock "cinder-09f55dbc-c43a-4828-8b21-ce77519e3b1a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:20:21 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9587dcf6-5b78-4479-90a5-d3c8ab5c7167 tempest-VolumesActionsTest-2078684481 None] Acquiring lock "cinder-quobyte-09f55dbc-c43a-4828-8b21-ce77519e3b1a" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:20:21 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9587dcf6-5b78-4479-90a5-d3c8ab5c7167 tempest-VolumesActionsTest-2078684481 None] Lock "cinder-quobyte-09f55dbc-c43a-4828-8b21-ce77519e3b1a" acquired by "delete_volume" :: waited 0.016s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:20:21 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b161e1-3f01-4287-9510-0eb6567657df]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:20:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9587dcf6-5b78-4479-90a5-d3c8ab5c7167 tempest-VolumesActionsTest-2078684481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-09f55dbc-c43a-4828-8b21-ce77519e3b1a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:21 devstack sudo[90106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-09f55dbc-c43a-4828-8b21-ce77519e3b1a Apr 28 19:20:22 devstack sudo[90106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:22 devstack sudo[90102]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3f19a726-41c0-4267-96a4-5c740ef75639 tempest-GroupSnapshotsTest-2116439637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b" returned: 0 in 0.898s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3f19a726-41c0-4267-96a4-5c740ef75639 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b.73b92201-0335-4af3-8d9a-f5ed2b0a5911 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:22 devstack sudo[90109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b.73b92201-0335-4af3-8d9a-f5ed2b0a5911 1G Apr 28 19:20:22 devstack sudo[90109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:22 devstack sudo[90106]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9587dcf6-5b78-4479-90a5-d3c8ab5c7167 tempest-VolumesActionsTest-2078684481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-09f55dbc-c43a-4828-8b21-ce77519e3b1a" returned: 0 in 0.792s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9587dcf6-5b78-4479-90a5-d3c8ab5c7167 tempest-VolumesActionsTest-2078684481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-09f55dbc-c43a-4828-8b21-ce77519e3b1a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:22 devstack sudo[90117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-09f55dbc-c43a-4828-8b21-ce77519e3b1a Apr 28 19:20:22 devstack sudo[90117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:22 devstack sudo[90109]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3f19a726-41c0-4267-96a4-5c740ef75639 tempest-GroupSnapshotsTest-2116439637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b.73b92201-0335-4af3-8d9a-f5ed2b0a5911 1G" returned: 0 in 0.862s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3f19a726-41c0-4267-96a4-5c740ef75639 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa9c9017-ed4c-4025-b87b-148737ffa45b -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b.73b92201-0335-4af3-8d9a-f5ed2b0a5911 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:22 devstack sudo[90120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa9c9017-ed4c-4025-b87b-148737ffa45b -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b.73b92201-0335-4af3-8d9a-f5ed2b0a5911 Apr 28 19:20:22 devstack sudo[90120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:23 devstack sudo[90117]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9587dcf6-5b78-4479-90a5-d3c8ab5c7167 tempest-VolumesActionsTest-2078684481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-09f55dbc-c43a-4828-8b21-ce77519e3b1a" returned: 0 in 0.638s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:23 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9587dcf6-5b78-4479-90a5-d3c8ab5c7167 tempest-VolumesActionsTest-2078684481 None] Lock "cinder-quobyte-09f55dbc-c43a-4828-8b21-ce77519e3b1a" released by "delete_volume" :: held 1.498s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:20:23 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-9587dcf6-5b78-4479-90a5-d3c8ab5c7167 tempest-VolumesActionsTest-2078684481 None] Created reservations ['0304df87-72c4-4c04-b7bd-3b44c7daa1c9', 'e9b6953e-ac5b-4ede-bad5-cf83e51789e8', '6a7d9c52-4f7f-4f1a-bda0-66e4aa402196', 'c478fd7b-b436-49cd-9c4a-960290c86921'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:20:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9587dcf6-5b78-4479-90a5-d3c8ab5c7167 tempest-VolumesActionsTest-2078684481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:20:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9587dcf6-5b78-4479-90a5-d3c8ab5c7167 tempest-VolumesActionsTest-2078684481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:20:23 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-9587dcf6-5b78-4479-90a5-d3c8ab5c7167 tempest-VolumesActionsTest-2078684481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:20:23 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-9587dcf6-5b78-4479-90a5-d3c8ab5c7167 tempest-VolumesActionsTest-2078684481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:20:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9587dcf6-5b78-4479-90a5-d3c8ab5c7167 tempest-VolumesActionsTest-2078684481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:20:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9587dcf6-5b78-4479-90a5-d3c8ab5c7167 tempest-VolumesActionsTest-2078684481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:23 devstack sudo[90123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:20:23 devstack sudo[90123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:23 devstack sudo[90120]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3f19a726-41c0-4267-96a4-5c740ef75639 tempest-GroupSnapshotsTest-2116439637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa9c9017-ed4c-4025-b87b-148737ffa45b -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b.73b92201-0335-4af3-8d9a-f5ed2b0a5911" returned: 0 in 0.703s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:23 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-3f19a726-41c0-4267-96a4-5c740ef75639 tempest-GroupSnapshotsTest-2116439637 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b.73b92201-0335-4af3-8d9a-f5ed2b0a5911 is being set with open permissions: ugo+rw: NotImplementedError Apr 28 19:20:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3f19a726-41c0-4267-96a4-5c740ef75639 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b.73b92201-0335-4af3-8d9a-f5ed2b0a5911 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:23 devstack sudo[90128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b.73b92201-0335-4af3-8d9a-f5ed2b0a5911 Apr 28 19:20:23 devstack sudo[90128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:23 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-b13a54f1-97d0-4f35-83f5-28547530925e tempest-VolumesCloneTest-48730616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:20:23 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b13a54f1-97d0-4f35-83f5-28547530925e tempest-VolumesCloneTest-48730616 None] Flow 'volume_create_manager' (5cd99d3c-4352-4b3f-8904-943c7ec8a98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:20:23 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b13a54f1-97d0-4f35-83f5-28547530925e tempest-VolumesCloneTest-48730616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a5cd61e-377a-4ab8-9da7-35e49a21fd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:23 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b13a54f1-97d0-4f35-83f5-28547530925e tempest-VolumesCloneTest-48730616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a5cd61e-377a-4ab8-9da7-35e49a21fd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1664690446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a5b440c-8865-40a1-8ae1-09748aec54b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b26b90191194c089c5a233f8eb0e4c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:20:24Z,use_quota=True,user_id='43038b436ceb49d7a4d0d6e3c07b4b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:23 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b13a54f1-97d0-4f35-83f5-28547530925e tempest-VolumesCloneTest-48730616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bed70d2-3499-4466-a62e-d14d244cf7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:23 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b13a54f1-97d0-4f35-83f5-28547530925e tempest-VolumesCloneTest-48730616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bed70d2-3499-4466-a62e-d14d244cf7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:23 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b13a54f1-97d0-4f35-83f5-28547530925e tempest-VolumesCloneTest-48730616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7f91be3-e070-41e7-873d-f103a2fe2389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:23 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b13a54f1-97d0-4f35-83f5-28547530925e tempest-VolumesCloneTest-48730616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7f91be3-e070-41e7-873d-f103a2fe2389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a5b440c-8865-40a1-8ae1-09748aec54b2', 'volume_name': 'volume-2a5b440c-8865-40a1-8ae1-09748aec54b2', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:23 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b13a54f1-97d0-4f35-83f5-28547530925e tempest-VolumesCloneTest-48730616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9647dddd-c2c7-4625-a6b5-2f2c31dca5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:23 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b13a54f1-97d0-4f35-83f5-28547530925e tempest-VolumesCloneTest-48730616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9647dddd-c2c7-4625-a6b5-2f2c31dca5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:23 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b13a54f1-97d0-4f35-83f5-28547530925e tempest-VolumesCloneTest-48730616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d345c7a6-c4dc-4352-a5c2-4e163f0717d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:23 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-b13a54f1-97d0-4f35-83f5-28547530925e tempest-VolumesCloneTest-48730616 None] Volume 2a5b440c-8865-40a1-8ae1-09748aec54b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a5b440c-8865-40a1-8ae1-09748aec54b2', 'volume_size': 1} Apr 28 19:20:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b13a54f1-97d0-4f35-83f5-28547530925e tempest-VolumesCloneTest-48730616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:20:24 devstack sudo[90123]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9587dcf6-5b78-4479-90a5-d3c8ab5c7167 tempest-VolumesActionsTest-2078684481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.723s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:24 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-9587dcf6-5b78-4479-90a5-d3c8ab5c7167 tempest-VolumesActionsTest-2078684481 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:20:24 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-9587dcf6-5b78-4479-90a5-d3c8ab5c7167 tempest-VolumesActionsTest-2078684481 None] Deleted volume successfully. Apr 28 19:20:24 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9587dcf6-5b78-4479-90a5-d3c8ab5c7167 tempest-VolumesActionsTest-2078684481 None] Lock "cinder-09f55dbc-c43a-4828-8b21-ce77519e3b1a-delete_volume" released by "delete_volume" :: held 2.477s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:20:24 devstack sudo[90128]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3f19a726-41c0-4267-96a4-5c740ef75639 tempest-GroupSnapshotsTest-2116439637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b.73b92201-0335-4af3-8d9a-f5ed2b0a5911" returned: 0 in 0.650s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3f19a726-41c0-4267-96a4-5c740ef75639 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:24 devstack sudo[90134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b.info Apr 28 19:20:24 devstack sudo[90134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:24 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-2783a2e9-11cc-4a57-b8e1-41b064e27daf tempest-VolumesActionsTest-1227654161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:20:24 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2783a2e9-11cc-4a57-b8e1-41b064e27daf tempest-VolumesActionsTest-1227654161 None] Flow 'volume_create_manager' (55a59ead-9d80-44df-9fad-9b61c7e654e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:20:24 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2783a2e9-11cc-4a57-b8e1-41b064e27daf tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29ad10f0-b993-463e-9291-a800b3f10985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:24 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2783a2e9-11cc-4a57-b8e1-41b064e27daf tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29ad10f0-b993-463e-9291-a800b3f10985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2001699692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3768fbe-a17d-44f0-9b63-cac498b5bee2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38e8856c75104814bef706d799fcb4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:20:24Z,use_quota=True,user_id='846797cf18734e7abb64f3e0f0e6c573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:24 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2783a2e9-11cc-4a57-b8e1-41b064e27daf tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dff7152f-2780-4fd2-a5b7-af4c87937ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:24 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2783a2e9-11cc-4a57-b8e1-41b064e27daf tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dff7152f-2780-4fd2-a5b7-af4c87937ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:24 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2783a2e9-11cc-4a57-b8e1-41b064e27daf tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54e76c28-37e8-41d4-a217-73c9ae17a262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:24 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2783a2e9-11cc-4a57-b8e1-41b064e27daf tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54e76c28-37e8-41d4-a217-73c9ae17a262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3768fbe-a17d-44f0-9b63-cac498b5bee2', 'volume_name': 'volume-d3768fbe-a17d-44f0-9b63-cac498b5bee2', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:24 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2783a2e9-11cc-4a57-b8e1-41b064e27daf tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb4c19a5-d16a-457a-be44-053b60bc81df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:24 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2783a2e9-11cc-4a57-b8e1-41b064e27daf tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb4c19a5-d16a-457a-be44-053b60bc81df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:24 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2783a2e9-11cc-4a57-b8e1-41b064e27daf tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ee2076e-5b27-4dd0-8769-017d87da0fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:24 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-2783a2e9-11cc-4a57-b8e1-41b064e27daf tempest-VolumesActionsTest-1227654161 None] Volume d3768fbe-a17d-44f0-9b63-cac498b5bee2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3768fbe-a17d-44f0-9b63-cac498b5bee2', 'volume_size': 1} Apr 28 19:20:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2783a2e9-11cc-4a57-b8e1-41b064e27daf tempest-VolumesActionsTest-1227654161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:20:24 devstack sudo[90134]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3f19a726-41c0-4267-96a4-5c740ef75639 tempest-GroupSnapshotsTest-2116439637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b.info" returned: 0 in 0.630s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:24 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-3f19a726-41c0-4267-96a4-5c740ef75639 tempest-GroupSnapshotsTest-2116439637 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b.info is being set with open permissions: ugo+rw: NotImplementedError Apr 28 19:20:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3f19a726-41c0-4267-96a4-5c740ef75639 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:24 devstack sudo[90137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b.info Apr 28 19:20:24 devstack sudo[90137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:25 devstack sudo[90137]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3f19a726-41c0-4267-96a4-5c740ef75639 tempest-GroupSnapshotsTest-2116439637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b.info" returned: 0 in 0.615s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3f19a726-41c0-4267-96a4-5c740ef75639 tempest-GroupSnapshotsTest-2116439637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.473s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:20:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b13a54f1-97d0-4f35-83f5-28547530925e tempest-VolumesCloneTest-48730616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.625s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:20:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b13a54f1-97d0-4f35-83f5-28547530925e tempest-VolumesCloneTest-48730616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1664690446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a5b440c-8865-40a1-8ae1-09748aec54b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b26b90191194c089c5a233f8eb0e4c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:20:24Z,use_quota=True,user_id='43038b436ceb49d7a4d0d6e3c07b4b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:20:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-b13a54f1-97d0-4f35-83f5-28547530925e tempest-VolumesCloneTest-48730616 None] Creating volume 2a5b440c-8865-40a1-8ae1-09748aec54b2 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:20:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b13a54f1-97d0-4f35-83f5-28547530925e tempest-VolumesCloneTest-48730616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:20:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b13a54f1-97d0-4f35-83f5-28547530925e tempest-VolumesCloneTest-48730616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:20:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b13a54f1-97d0-4f35-83f5-28547530925e tempest-VolumesCloneTest-48730616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:20:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b13a54f1-97d0-4f35-83f5-28547530925e tempest-VolumesCloneTest-48730616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:20:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b13a54f1-97d0-4f35-83f5-28547530925e tempest-VolumesCloneTest-48730616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:20:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b13a54f1-97d0-4f35-83f5-28547530925e tempest-VolumesCloneTest-48730616 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:20:25 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-b13a54f1-97d0-4f35-83f5-28547530925e tempest-VolumesCloneTest-48730616 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:20:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b13a54f1-97d0-4f35-83f5-28547530925e tempest-VolumesCloneTest-48730616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:25 devstack sudo[90140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2 1073741824 Apr 28 19:20:25 devstack sudo[90140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:25 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-3f19a726-41c0-4267-96a4-5c740ef75639 tempest-GroupSnapshotsTest-2116439637 None] group_snapshot 9ccfd57b-e351-4b57-b88a-43838a0c7785: created successfully Apr 28 19:20:26 devstack sudo[90140]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b13a54f1-97d0-4f35-83f5-28547530925e tempest-VolumesCloneTest-48730616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2 1073741824" returned: 0 in 0.783s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b13a54f1-97d0-4f35-83f5-28547530925e tempest-VolumesCloneTest-48730616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:26 devstack sudo[90145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2 Apr 28 19:20:26 devstack sudo[90145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b6382fe3-27ed-40e1-a5e3-7bf72bcc5855 tempest-GroupSnapshotsTest-2116439637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:20:27 devstack sudo[90145]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b13a54f1-97d0-4f35-83f5-28547530925e tempest-VolumesCloneTest-48730616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2" returned: 0 in 0.647s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:27 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b13a54f1-97d0-4f35-83f5-28547530925e tempest-VolumesCloneTest-48730616 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:20:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b13a54f1-97d0-4f35-83f5-28547530925e tempest-VolumesCloneTest-48730616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.468s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:20:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2783a2e9-11cc-4a57-b8e1-41b064e27daf tempest-VolumesActionsTest-1227654161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.532s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:20:27 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2783a2e9-11cc-4a57-b8e1-41b064e27daf tempest-VolumesActionsTest-1227654161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2001699692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3768fbe-a17d-44f0-9b63-cac498b5bee2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38e8856c75104814bef706d799fcb4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:20:24Z,use_quota=True,user_id='846797cf18734e7abb64f3e0f0e6c573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:20:27 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-2783a2e9-11cc-4a57-b8e1-41b064e27daf tempest-VolumesActionsTest-1227654161 None] Creating volume d3768fbe-a17d-44f0-9b63-cac498b5bee2 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:20:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2783a2e9-11cc-4a57-b8e1-41b064e27daf tempest-VolumesActionsTest-1227654161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:20:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2783a2e9-11cc-4a57-b8e1-41b064e27daf tempest-VolumesActionsTest-1227654161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:20:27 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2783a2e9-11cc-4a57-b8e1-41b064e27daf tempest-VolumesActionsTest-1227654161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:20:27 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2783a2e9-11cc-4a57-b8e1-41b064e27daf tempest-VolumesActionsTest-1227654161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:20:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2783a2e9-11cc-4a57-b8e1-41b064e27daf tempest-VolumesActionsTest-1227654161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:20:27 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2783a2e9-11cc-4a57-b8e1-41b064e27daf tempest-VolumesActionsTest-1227654161 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:20:27 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-2783a2e9-11cc-4a57-b8e1-41b064e27daf tempest-VolumesActionsTest-1227654161 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:20:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2783a2e9-11cc-4a57-b8e1-41b064e27daf tempest-VolumesActionsTest-1227654161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d3768fbe-a17d-44f0-9b63-cac498b5bee2 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:27 devstack sudo[90148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d3768fbe-a17d-44f0-9b63-cac498b5bee2 1073741824 Apr 28 19:20:27 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b13a54f1-97d0-4f35-83f5-28547530925e tempest-VolumesCloneTest-48730616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d345c7a6-c4dc-4352-a5c2-4e163f0717d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a5b440c-8865-40a1-8ae1-09748aec54b2', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:27 devstack sudo[90148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:27 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b13a54f1-97d0-4f35-83f5-28547530925e tempest-VolumesCloneTest-48730616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0faf3f3b-f5c7-4f3c-8426-7a1f118a2caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:27 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-b13a54f1-97d0-4f35-83f5-28547530925e tempest-VolumesCloneTest-48730616 None] Volume volume-2a5b440c-8865-40a1-8ae1-09748aec54b2 (2a5b440c-8865-40a1-8ae1-09748aec54b2): created successfully Apr 28 19:20:27 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b13a54f1-97d0-4f35-83f5-28547530925e tempest-VolumesCloneTest-48730616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0faf3f3b-f5c7-4f3c-8426-7a1f118a2caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:27 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b13a54f1-97d0-4f35-83f5-28547530925e tempest-VolumesCloneTest-48730616 None] Flow 'volume_create_manager' (5cd99d3c-4352-4b3f-8904-943c7ec8a98a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:20:27 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-b13a54f1-97d0-4f35-83f5-28547530925e tempest-VolumesCloneTest-48730616 None] Created volume successfully. Apr 28 19:20:27 devstack sudo[90148]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2783a2e9-11cc-4a57-b8e1-41b064e27daf tempest-VolumesActionsTest-1227654161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d3768fbe-a17d-44f0-9b63-cac498b5bee2 1073741824" returned: 0 in 0.762s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2783a2e9-11cc-4a57-b8e1-41b064e27daf tempest-VolumesActionsTest-1227654161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d3768fbe-a17d-44f0-9b63-cac498b5bee2 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:27 devstack sudo[90153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d3768fbe-a17d-44f0-9b63-cac498b5bee2 Apr 28 19:20:27 devstack sudo[90153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:28 devstack sudo[90153]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2783a2e9-11cc-4a57-b8e1-41b064e27daf tempest-VolumesActionsTest-1227654161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d3768fbe-a17d-44f0-9b63-cac498b5bee2" returned: 0 in 0.645s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:28 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2783a2e9-11cc-4a57-b8e1-41b064e27daf tempest-VolumesActionsTest-1227654161 None] <== create_volume: return (1443ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:20:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2783a2e9-11cc-4a57-b8e1-41b064e27daf tempest-VolumesActionsTest-1227654161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.445s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:20:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b6382fe3-27ed-40e1-a5e3-7bf72bcc5855 tempest-GroupSnapshotsTest-2116439637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.594s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:20:28 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-b6382fe3-27ed-40e1-a5e3-7bf72bcc5855 tempest-GroupSnapshotsTest-2116439637 None] Acquiring lock "cinder-quobyte-73b92201-0335-4af3-8d9a-f5ed2b0a5911-53aa19c6-af88-4f38-b72f-4539a237a75a" by "_create_volume_from_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:20:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2783a2e9-11cc-4a57-b8e1-41b064e27daf tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ee2076e-5b27-4dd0-8769-017d87da0fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3768fbe-a17d-44f0-9b63-cac498b5bee2', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2783a2e9-11cc-4a57-b8e1-41b064e27daf tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f733330-06ba-46ba-b2ed-e2a6f5c20779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:28 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-b6382fe3-27ed-40e1-a5e3-7bf72bcc5855 tempest-GroupSnapshotsTest-2116439637 None] Lock "cinder-quobyte-73b92201-0335-4af3-8d9a-f5ed2b0a5911-53aa19c6-af88-4f38-b72f-4539a237a75a" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:20:28 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b6382fe3-27ed-40e1-a5e3-7bf72bcc5855 tempest-GroupSnapshotsTest-2116439637 None] Creating volume 53aa19c6-af88-4f38-b72f-4539a237a75a from snapshot 73b92201-0335-4af3-8d9a-f5ed2b0a5911 {{(pid=83863) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 28 19:20:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b6382fe3-27ed-40e1-a5e3-7bf72bcc5855 tempest-GroupSnapshotsTest-2116439637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:20:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b6382fe3-27ed-40e1-a5e3-7bf72bcc5855 tempest-GroupSnapshotsTest-2116439637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:20:28 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b6382fe3-27ed-40e1-a5e3-7bf72bcc5855 tempest-GroupSnapshotsTest-2116439637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:20:28 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b6382fe3-27ed-40e1-a5e3-7bf72bcc5855 tempest-GroupSnapshotsTest-2116439637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:20:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b6382fe3-27ed-40e1-a5e3-7bf72bcc5855 tempest-GroupSnapshotsTest-2116439637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:20:28 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b6382fe3-27ed-40e1-a5e3-7bf72bcc5855 tempest-GroupSnapshotsTest-2116439637 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:20:28 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-b6382fe3-27ed-40e1-a5e3-7bf72bcc5855 tempest-GroupSnapshotsTest-2116439637 None] Acquiring lock "cinder-quobyte-53aa19c6-af88-4f38-b72f-4539a237a75a" by "_copy_volume_from_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:20:28 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:20:28 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-2783a2e9-11cc-4a57-b8e1-41b064e27daf tempest-VolumesActionsTest-1227654161 None] Volume volume-d3768fbe-a17d-44f0-9b63-cac498b5bee2 (d3768fbe-a17d-44f0-9b63-cac498b5bee2): created successfully Apr 28 19:20:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2783a2e9-11cc-4a57-b8e1-41b064e27daf tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f733330-06ba-46ba-b2ed-e2a6f5c20779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2783a2e9-11cc-4a57-b8e1-41b064e27daf tempest-VolumesActionsTest-1227654161 None] Flow 'volume_create_manager' (55a59ead-9d80-44df-9fad-9b61c7e654e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:20:28 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-b6382fe3-27ed-40e1-a5e3-7bf72bcc5855 tempest-GroupSnapshotsTest-2116439637 None] Lock "cinder-quobyte-53aa19c6-af88-4f38-b72f-4539a237a75a" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:20:28 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b6382fe3-27ed-40e1-a5e3-7bf72bcc5855 tempest-GroupSnapshotsTest-2116439637 None] snapshot: 73b92201-0335-4af3-8d9a-f5ed2b0a5911, volume: 53aa19c6-af88-4f38-b72f-4539a237a75a, {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 19:20:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Flow 'volume_create_manager' (dd3dc469-6d0d-4571-9117-b8c552708440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:20:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a49f7aa2-33d3-4ac6-b684-3a2934e41a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:28 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-2783a2e9-11cc-4a57-b8e1-41b064e27daf tempest-VolumesActionsTest-1227654161 None] Created volume successfully. Apr 28 19:20:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b6382fe3-27ed-40e1-a5e3-7bf72bcc5855 tempest-GroupSnapshotsTest-2116439637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:20:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b6382fe3-27ed-40e1-a5e3-7bf72bcc5855 tempest-GroupSnapshotsTest-2116439637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:20:28 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b6382fe3-27ed-40e1-a5e3-7bf72bcc5855 tempest-GroupSnapshotsTest-2116439637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:20:28 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b6382fe3-27ed-40e1-a5e3-7bf72bcc5855 tempest-GroupSnapshotsTest-2116439637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:20:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b6382fe3-27ed-40e1-a5e3-7bf72bcc5855 tempest-GroupSnapshotsTest-2116439637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:20:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a49f7aa2-33d3-4ac6-b684-3a2934e41a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:20:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-303013827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3913fd5-3f8c-44fc-814a-9bf2a6c03630,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b26b90191194c089c5a233f8eb0e4c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:20:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=2a5b440c-8865-40a1-8ae1-09748aec54b2,status='creating',terminated_at=None,updated_at=2026-04-28T17:20:28Z,use_quota=True,user_id='43038b436ceb49d7a4d0d6e3c07b4b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29ad71c6-2c00-462e-87b4-5f5791d629c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29ad71c6-2c00-462e-87b4-5f5791d629c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74bbf490-dfb2-40a4-a8be-25a90f3a3d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:28 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bdb4e88-d1fe-4780-b196-00b1eaab2ad5]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:20:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b6382fe3-27ed-40e1-a5e3-7bf72bcc5855 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b.73b92201-0335-4af3-8d9a-f5ed2b0a5911 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74bbf490-dfb2-40a4-a8be-25a90f3a3d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c3913fd5-3f8c-44fc-814a-9bf2a6c03630', 'volume_name': 'volume-c3913fd5-3f8c-44fc-814a-9bf2a6c03630', 'volume_size': 2, 'source_volid': '2a5b440c-8865-40a1-8ae1-09748aec54b2', 'source_volstatus': 'available'}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe4b4ed0-f4a1-4fce-8772-687cabfade9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe4b4ed0-f4a1-4fce-8772-687cabfade9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef552cb7-d3af-4c40-b0d3-55f207cd4217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:28 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Volume c3913fd5-3f8c-44fc-814a-9bf2a6c03630: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c3913fd5-3f8c-44fc-814a-9bf2a6c03630', 'volume_size': 2, 'source_volid': '2a5b440c-8865-40a1-8ae1-09748aec54b2', 'source_volstatus': 'available'} Apr 28 19:20:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:20:28 devstack sudo[90156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b.73b92201-0335-4af3-8d9a-f5ed2b0a5911 Apr 28 19:20:28 devstack sudo[90156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:28 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9ec722ce-504e-4ea2-b06f-c19583daf223 tempest-VolumesActionsTest-2078684481 None] Acquiring lock "cinder-d3768fbe-a17d-44f0-9b63-cac498b5bee2-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:20:28 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9ec722ce-504e-4ea2-b06f-c19583daf223 tempest-VolumesActionsTest-2078684481 None] Lock "cinder-d3768fbe-a17d-44f0-9b63-cac498b5bee2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:20:28 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9ec722ce-504e-4ea2-b06f-c19583daf223 tempest-VolumesActionsTest-2078684481 None] Acquiring lock "cinder-quobyte-d3768fbe-a17d-44f0-9b63-cac498b5bee2" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:20:28 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9ec722ce-504e-4ea2-b06f-c19583daf223 tempest-VolumesActionsTest-2078684481 None] Lock "cinder-quobyte-d3768fbe-a17d-44f0-9b63-cac498b5bee2" acquired by "delete_volume" :: waited 0.018s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:20:28 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea3d788-7b92-4e1a-adc0-87e5150cb8d3]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:20:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9ec722ce-504e-4ea2-b06f-c19583daf223 tempest-VolumesActionsTest-2078684481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d3768fbe-a17d-44f0-9b63-cac498b5bee2 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:29 devstack sudo[90158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d3768fbe-a17d-44f0-9b63-cac498b5bee2 Apr 28 19:20:29 devstack sudo[90158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:29 devstack sudo[90156]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b6382fe3-27ed-40e1-a5e3-7bf72bcc5855 tempest-GroupSnapshotsTest-2116439637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b.73b92201-0335-4af3-8d9a-f5ed2b0a5911" returned: 0 in 0.740s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:29 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-b6382fe3-27ed-40e1-a5e3-7bf72bcc5855 tempest-GroupSnapshotsTest-2116439637 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa9c9017-ed4c-4025-b87b-148737ffa45b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:20:29 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b6382fe3-27ed-40e1-a5e3-7bf72bcc5855 tempest-GroupSnapshotsTest-2116439637 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 19:20:29 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b6382fe3-27ed-40e1-a5e3-7bf72bcc5855 tempest-GroupSnapshotsTest-2116439637 None] Creating direct copy from snapshot {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 19:20:29 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07086f5-36fb-44fe-b0aa-dd143f097be3]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:20:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b6382fe3-27ed-40e1-a5e3-7bf72bcc5855 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:29 devstack sudo[90163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b Apr 28 19:20:29 devstack sudo[90163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:29 devstack sudo[90158]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9ec722ce-504e-4ea2-b06f-c19583daf223 tempest-VolumesActionsTest-2078684481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d3768fbe-a17d-44f0-9b63-cac498b5bee2" returned: 0 in 0.754s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9ec722ce-504e-4ea2-b06f-c19583daf223 tempest-VolumesActionsTest-2078684481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d3768fbe-a17d-44f0-9b63-cac498b5bee2 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:29 devstack sudo[90168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d3768fbe-a17d-44f0-9b63-cac498b5bee2 Apr 28 19:20:29 devstack sudo[90168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:30 devstack sudo[90163]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b6382fe3-27ed-40e1-a5e3-7bf72bcc5855 tempest-GroupSnapshotsTest-2116439637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b" returned: 0 in 0.732s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:30 devstack cinder-volume[83863]: DEBUG cinder.utils [None req-b6382fe3-27ed-40e1-a5e3-7bf72bcc5855 tempest-GroupSnapshotsTest-2116439637 None] Path /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-53aa19c6-af88-4f38-b72f-4539a237a75a not found in is_blk_device check {{(pid=83863) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 19:20:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b6382fe3-27ed-40e1-a5e3-7bf72bcc5855 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-53aa19c6-af88-4f38-b72f-4539a237a75a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:30 devstack sudo[90173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-53aa19c6-af88-4f38-b72f-4539a237a75a Apr 28 19:20:30 devstack sudo[90173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:30 devstack sudo[90168]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9ec722ce-504e-4ea2-b06f-c19583daf223 tempest-VolumesActionsTest-2078684481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d3768fbe-a17d-44f0-9b63-cac498b5bee2" returned: 0 in 0.634s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:30 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9ec722ce-504e-4ea2-b06f-c19583daf223 tempest-VolumesActionsTest-2078684481 None] Lock "cinder-quobyte-d3768fbe-a17d-44f0-9b63-cac498b5bee2" released by "delete_volume" :: held 1.445s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:20:30 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-9ec722ce-504e-4ea2-b06f-c19583daf223 tempest-VolumesActionsTest-2078684481 None] Created reservations ['bd03683a-d601-4ee8-b13f-8df1a71b7ae0', '49f1fb0f-2124-4e67-ae5c-fc8d8338e4a3', '1beb7434-d0ec-42ab-8c29-db2e74c5fb3f', '5dfcd720-d82d-44d7-b5cf-20d2ea31df36'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:20:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9ec722ce-504e-4ea2-b06f-c19583daf223 tempest-VolumesActionsTest-2078684481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:20:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9ec722ce-504e-4ea2-b06f-c19583daf223 tempest-VolumesActionsTest-2078684481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:20:30 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-9ec722ce-504e-4ea2-b06f-c19583daf223 tempest-VolumesActionsTest-2078684481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:20:30 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-9ec722ce-504e-4ea2-b06f-c19583daf223 tempest-VolumesActionsTest-2078684481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:20:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9ec722ce-504e-4ea2-b06f-c19583daf223 tempest-VolumesActionsTest-2078684481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:20:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9ec722ce-504e-4ea2-b06f-c19583daf223 tempest-VolumesActionsTest-2078684481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:30 devstack sudo[90176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:20:30 devstack sudo[90176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:31 devstack sudo[90176]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9ec722ce-504e-4ea2-b06f-c19583daf223 tempest-VolumesActionsTest-2078684481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.880s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:31 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-9ec722ce-504e-4ea2-b06f-c19583daf223 tempest-VolumesActionsTest-2078684481 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:20:31 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-9ec722ce-504e-4ea2-b06f-c19583daf223 tempest-VolumesActionsTest-2078684481 None] Deleted volume successfully. Apr 28 19:20:31 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9ec722ce-504e-4ea2-b06f-c19583daf223 tempest-VolumesActionsTest-2078684481 None] Lock "cinder-d3768fbe-a17d-44f0-9b63-cac498b5bee2-delete_volume" released by "delete_volume" :: held 2.584s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:20:32 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4300599-13ae-40ac-80c0-81d6b950b5e7 tempest-VolumesActionsTest-1227654161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:20:32 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b4300599-13ae-40ac-80c0-81d6b950b5e7 tempest-VolumesActionsTest-1227654161 None] Flow 'volume_create_manager' (069206a7-9e9c-4503-8551-731d337129da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:20:32 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b4300599-13ae-40ac-80c0-81d6b950b5e7 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3425f6c0-d0aa-43d4-8a20-0ea9e7ed918d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:32 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b4300599-13ae-40ac-80c0-81d6b950b5e7 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3425f6c0-d0aa-43d4-8a20-0ea9e7ed918d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2131486623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56d5a519-fa6a-4743-9f61-abb8c0e3cfc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38e8856c75104814bef706d799fcb4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:20:32Z,use_quota=True,user_id='846797cf18734e7abb64f3e0f0e6c573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:32 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b4300599-13ae-40ac-80c0-81d6b950b5e7 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4ff5826-f1fd-470c-b7d6-26f5536ac328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:32 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b4300599-13ae-40ac-80c0-81d6b950b5e7 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4ff5826-f1fd-470c-b7d6-26f5536ac328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:32 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b4300599-13ae-40ac-80c0-81d6b950b5e7 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbc66fa4-cd87-447f-baa5-1b63449a8dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:32 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b4300599-13ae-40ac-80c0-81d6b950b5e7 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbc66fa4-cd87-447f-baa5-1b63449a8dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56d5a519-fa6a-4743-9f61-abb8c0e3cfc4', 'volume_name': 'volume-56d5a519-fa6a-4743-9f61-abb8c0e3cfc4', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:32 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b4300599-13ae-40ac-80c0-81d6b950b5e7 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (264fe5a0-c8fc-49ce-8ca1-deffcde6d535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:32 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b4300599-13ae-40ac-80c0-81d6b950b5e7 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (264fe5a0-c8fc-49ce-8ca1-deffcde6d535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:32 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b4300599-13ae-40ac-80c0-81d6b950b5e7 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af3c60cf-a47d-4258-94c9-39273bf59888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:32 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-b4300599-13ae-40ac-80c0-81d6b950b5e7 tempest-VolumesActionsTest-1227654161 None] Volume 56d5a519-fa6a-4743-9f61-abb8c0e3cfc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56d5a519-fa6a-4743-9f61-abb8c0e3cfc4', 'volume_size': 1} Apr 28 19:20:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b4300599-13ae-40ac-80c0-81d6b950b5e7 tempest-VolumesActionsTest-1227654161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:20:35 devstack sudo[90173]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b6382fe3-27ed-40e1-a5e3-7bf72bcc5855 tempest-GroupSnapshotsTest-2116439637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-53aa19c6-af88-4f38-b72f-4539a237a75a" returned: 0 in 5.201s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:35 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[42872147-f8ea-41d1-beb1-ed65afb2f9f2]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:20:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b6382fe3-27ed-40e1-a5e3-7bf72bcc5855 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:35 devstack sudo[90194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b Apr 28 19:20:35 devstack sudo[90194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:36 devstack sudo[90194]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b6382fe3-27ed-40e1-a5e3-7bf72bcc5855 tempest-GroupSnapshotsTest-2116439637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b" returned: 0 in 0.890s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:36 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-b6382fe3-27ed-40e1-a5e3-7bf72bcc5855 tempest-GroupSnapshotsTest-2116439637 None] Image conversion details: src /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b, size 1024.00 MB, duration 5.20 sec, destination /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-53aa19c6-af88-4f38-b72f-4539a237a75a {{(pid=83863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 19:20:36 devstack cinder-volume[83863]: INFO cinder.image.image_utils [None req-b6382fe3-27ed-40e1-a5e3-7bf72bcc5855 tempest-GroupSnapshotsTest-2116439637 None] Converted 1024.00 MB image at 196.85 MB/s Apr 28 19:20:36 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-b6382fe3-27ed-40e1-a5e3-7bf72bcc5855 tempest-GroupSnapshotsTest-2116439637 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-53aa19c6-af88-4f38-b72f-4539a237a75a is being set with open permissions: ugo+rw: NotImplementedError Apr 28 19:20:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b6382fe3-27ed-40e1-a5e3-7bf72bcc5855 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-53aa19c6-af88-4f38-b72f-4539a237a75a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:36 devstack sudo[90235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-53aa19c6-af88-4f38-b72f-4539a237a75a Apr 28 19:20:36 devstack sudo[90235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:36 devstack sudo[90235]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b6382fe3-27ed-40e1-a5e3-7bf72bcc5855 tempest-GroupSnapshotsTest-2116439637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-53aa19c6-af88-4f38-b72f-4539a237a75a" returned: 0 in 0.603s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:36 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-b6382fe3-27ed-40e1-a5e3-7bf72bcc5855 tempest-GroupSnapshotsTest-2116439637 None] Lock "cinder-quobyte-53aa19c6-af88-4f38-b72f-4539a237a75a" released by "_copy_volume_from_snapshot" :: held 8.309s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:20:36 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-b6382fe3-27ed-40e1-a5e3-7bf72bcc5855 tempest-GroupSnapshotsTest-2116439637 None] Lock "cinder-quobyte-73b92201-0335-4af3-8d9a-f5ed2b0a5911-53aa19c6-af88-4f38-b72f-4539a237a75a" released by "_create_volume_from_snapshot" :: held 8.364s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:20:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b6382fe3-27ed-40e1-a5e3-7bf72bcc5855 tempest-GroupSnapshotsTest-2116439637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.401s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:20:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 8.166s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:20:36 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Cloning volume 2a5b440c-8865-40a1-8ae1-09748aec54b2 to volume c3913fd5-3f8c-44fc-814a-9bf2a6c03630 Apr 28 19:20:36 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Creating offline snapshot b361d4d4-3bf8-418f-85f5-9c942d1988d6 of volume 2a5b440c-8865-40a1-8ae1-09748aec54b2 {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 19:20:36 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[71952381-cb92-423b-b697-756018be629b]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:20:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:37 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-b6382fe3-27ed-40e1-a5e3-7bf72bcc5855 tempest-GroupSnapshotsTest-2116439637 None] Create group from source-snapshot-9ccfd57b-e351-4b57-b88a-43838a0c7785 completed successfully. Apr 28 19:20:37 devstack sudo[90238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2 Apr 28 19:20:37 devstack sudo[90238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:37 devstack sudo[90238]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2" returned: 0 in 0.747s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2.b361d4d4-3bf8-418f-85f5-9c942d1988d6 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:37 devstack sudo[90243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2.b361d4d4-3bf8-418f-85f5-9c942d1988d6 1G Apr 28 19:20:37 devstack sudo[90243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:37 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-263c71e6-5500-4a5a-a748-6f394d7bc18c tempest-GroupSnapshotsTest-2116439637 None] Acquiring lock "cinder-quobyte-53aa19c6-af88-4f38-b72f-4539a237a75a" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:20:37 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-263c71e6-5500-4a5a-a748-6f394d7bc18c tempest-GroupSnapshotsTest-2116439637 None] Lock "cinder-quobyte-53aa19c6-af88-4f38-b72f-4539a237a75a" acquired by "delete_volume" :: waited 0.022s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:20:37 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e35756-f06f-45d5-aa8b-ab09edea63ab]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:20:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-263c71e6-5500-4a5a-a748-6f394d7bc18c tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-53aa19c6-af88-4f38-b72f-4539a237a75a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:37 devstack sudo[90245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-53aa19c6-af88-4f38-b72f-4539a237a75a Apr 28 19:20:37 devstack sudo[90245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:38 devstack sudo[90243]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2.b361d4d4-3bf8-418f-85f5-9c942d1988d6 1G" returned: 0 in 0.782s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a5b440c-8865-40a1-8ae1-09748aec54b2 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2.b361d4d4-3bf8-418f-85f5-9c942d1988d6 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:38 devstack sudo[90253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a5b440c-8865-40a1-8ae1-09748aec54b2 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2.b361d4d4-3bf8-418f-85f5-9c942d1988d6 Apr 28 19:20:38 devstack sudo[90253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:38 devstack sudo[90245]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-263c71e6-5500-4a5a-a748-6f394d7bc18c tempest-GroupSnapshotsTest-2116439637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-53aa19c6-af88-4f38-b72f-4539a237a75a" returned: 0 in 0.735s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-263c71e6-5500-4a5a-a748-6f394d7bc18c tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-53aa19c6-af88-4f38-b72f-4539a237a75a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:38 devstack sudo[90255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-53aa19c6-af88-4f38-b72f-4539a237a75a Apr 28 19:20:38 devstack sudo[90255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:39 devstack sudo[90253]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a5b440c-8865-40a1-8ae1-09748aec54b2 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2.b361d4d4-3bf8-418f-85f5-9c942d1988d6" returned: 0 in 0.652s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:39 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2.b361d4d4-3bf8-418f-85f5-9c942d1988d6 is being set with open permissions: ugo+rw Apr 28 19:20:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2.b361d4d4-3bf8-418f-85f5-9c942d1988d6 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:39 devstack sudo[90261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2.b361d4d4-3bf8-418f-85f5-9c942d1988d6 Apr 28 19:20:39 devstack sudo[90261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:39 devstack sudo[90255]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-263c71e6-5500-4a5a-a748-6f394d7bc18c tempest-GroupSnapshotsTest-2116439637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-53aa19c6-af88-4f38-b72f-4539a237a75a" returned: 0 in 0.597s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:39 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-263c71e6-5500-4a5a-a748-6f394d7bc18c tempest-GroupSnapshotsTest-2116439637 None] Lock "cinder-quobyte-53aa19c6-af88-4f38-b72f-4539a237a75a" released by "delete_volume" :: held 1.400s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:20:39 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-263c71e6-5500-4a5a-a748-6f394d7bc18c tempest-GroupSnapshotsTest-2116439637 None] Created reservations ['2fc8b90d-5996-4891-99e0-ae9cb0ba3db5'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:20:39 devstack cinder-volume[83863]: WARNING cinder.quota [None req-263c71e6-5500-4a5a-a748-6f394d7bc18c tempest-GroupSnapshotsTest-2116439637 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2024518117 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2024518117, it is now deprecated. Please use the default quota class for default quota. Apr 28 19:20:39 devstack cinder-volume[83863]: WARNING cinder.quota [None req-263c71e6-5500-4a5a-a748-6f394d7bc18c tempest-GroupSnapshotsTest-2116439637 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2024518117 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2024518117, it is now deprecated. Please use the default quota class for default quota. Apr 28 19:20:39 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-263c71e6-5500-4a5a-a748-6f394d7bc18c tempest-GroupSnapshotsTest-2116439637 None] Created reservations ['9b4eb017-ac2f-4fdd-9cc0-fa78a9dc40b9', '2faf4876-7139-4f08-b513-24a6b5eed0da', '1ad23019-c619-481a-b55b-b2c472f9cabe', '4a9c136d-985e-499d-a8b8-6f8407e5fa60'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:20:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-263c71e6-5500-4a5a-a748-6f394d7bc18c tempest-GroupSnapshotsTest-2116439637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:20:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-263c71e6-5500-4a5a-a748-6f394d7bc18c tempest-GroupSnapshotsTest-2116439637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:20:39 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-263c71e6-5500-4a5a-a748-6f394d7bc18c tempest-GroupSnapshotsTest-2116439637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:20:39 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-263c71e6-5500-4a5a-a748-6f394d7bc18c tempest-GroupSnapshotsTest-2116439637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:20:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-263c71e6-5500-4a5a-a748-6f394d7bc18c tempest-GroupSnapshotsTest-2116439637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:20:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-263c71e6-5500-4a5a-a748-6f394d7bc18c tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:39 devstack sudo[90263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:20:39 devstack sudo[90263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:39 devstack sudo[90261]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2.b361d4d4-3bf8-418f-85f5-9c942d1988d6" returned: 0 in 0.645s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:39 devstack sudo[90266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2.info Apr 28 19:20:39 devstack sudo[90266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:40 devstack sudo[90263]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-263c71e6-5500-4a5a-a748-6f394d7bc18c tempest-GroupSnapshotsTest-2116439637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.622s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:40 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-263c71e6-5500-4a5a-a748-6f394d7bc18c tempest-GroupSnapshotsTest-2116439637 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:20:40 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-263c71e6-5500-4a5a-a748-6f394d7bc18c tempest-GroupSnapshotsTest-2116439637 None] Delete group completed successfully. Apr 28 19:20:40 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-012111fe-fe56-439b-b1fd-ca9576ffdae4 tempest-GroupSnapshotsTest-2116439637 None] group_snapshot 9ccfd57b-e351-4b57-b88a-43838a0c7785: deleting Apr 28 19:20:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-012111fe-fe56-439b-b1fd-ca9576ffdae4 tempest-GroupSnapshotsTest-2116439637 None] group_snapshot 9ccfd57b-e351-4b57-b88a-43838a0c7785: deleting {{(pid=83863) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 28 19:20:40 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-012111fe-fe56-439b-b1fd-ca9576ffdae4 tempest-GroupSnapshotsTest-2116439637 None] Acquiring lock "cinder-quobyte-fa9c9017-ed4c-4025-b87b-148737ffa45b" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:20:40 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-012111fe-fe56-439b-b1fd-ca9576ffdae4 tempest-GroupSnapshotsTest-2116439637 None] Lock "cinder-quobyte-fa9c9017-ed4c-4025-b87b-148737ffa45b" acquired by "delete_snapshot" :: waited 0.034s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:20:40 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-012111fe-fe56-439b-b1fd-ca9576ffdae4 tempest-GroupSnapshotsTest-2116439637 None] Acquiring lock "cinder-quobyte-73b92201-0335-4af3-8d9a-f5ed2b0a5911" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:20:40 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-012111fe-fe56-439b-b1fd-ca9576ffdae4 tempest-GroupSnapshotsTest-2116439637 None] Lock "cinder-quobyte-73b92201-0335-4af3-8d9a-f5ed2b0a5911" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:20:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-012111fe-fe56-439b-b1fd-ca9576ffdae4 tempest-GroupSnapshotsTest-2116439637 None] Deleting offline snapshot 73b92201-0335-4af3-8d9a-f5ed2b0a5911 of volume fa9c9017-ed4c-4025-b87b-148737ffa45b {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 19:20:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-012111fe-fe56-439b-b1fd-ca9576ffdae4 tempest-GroupSnapshotsTest-2116439637 None] snapshot_file for this snap is: volume-fa9c9017-ed4c-4025-b87b-148737ffa45b.73b92201-0335-4af3-8d9a-f5ed2b0a5911 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 19:20:40 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[61132c88-ccca-4053-90f5-3515d81c18d5]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:20:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-012111fe-fe56-439b-b1fd-ca9576ffdae4 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b.73b92201-0335-4af3-8d9a-f5ed2b0a5911 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:40 devstack sudo[90269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b.73b92201-0335-4af3-8d9a-f5ed2b0a5911 Apr 28 19:20:40 devstack sudo[90269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:40 devstack sudo[90266]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2.info" returned: 0 in 0.634s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:40 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2.info is being set with open permissions: ugo+rw Apr 28 19:20:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:40 devstack sudo[90272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2.info Apr 28 19:20:40 devstack sudo[90272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:41 devstack sudo[90269]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-012111fe-fe56-439b-b1fd-ca9576ffdae4 tempest-GroupSnapshotsTest-2116439637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b.73b92201-0335-4af3-8d9a-f5ed2b0a5911" returned: 0 in 0.738s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:41 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-012111fe-fe56-439b-b1fd-ca9576ffdae4 tempest-GroupSnapshotsTest-2116439637 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa9c9017-ed4c-4025-b87b-148737ffa45b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:20:41 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e67fa02-80cf-4ed6-bebc-4e6f6d3fa2c6]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:20:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-012111fe-fe56-439b-b1fd-ca9576ffdae4 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:41 devstack sudo[90272]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2.info" returned: 0 in 0.589s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:41 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Acquiring lock "cinder-quobyte-c3913fd5-3f8c-44fc-814a-9bf2a6c03630" by "_copy_volume_from_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:20:41 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Lock "cinder-quobyte-c3913fd5-3f8c-44fc-814a-9bf2a6c03630" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:20:41 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] snapshot: b361d4d4-3bf8-418f-85f5-9c942d1988d6, volume: c3913fd5-3f8c-44fc-814a-9bf2a6c03630, {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 19:20:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:20:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:20:41 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:20:41 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:20:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:20:41 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7630bcef-9765-4528-91dd-2e838506d216]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:20:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2.b361d4d4-3bf8-418f-85f5-9c942d1988d6 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:41 devstack sudo[90279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b Apr 28 19:20:41 devstack sudo[90279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:41 devstack sudo[90280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2.b361d4d4-3bf8-418f-85f5-9c942d1988d6 Apr 28 19:20:41 devstack sudo[90280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:41 devstack sudo[90279]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-012111fe-fe56-439b-b1fd-ca9576ffdae4 tempest-GroupSnapshotsTest-2116439637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b" returned: 0 in 0.781s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-012111fe-fe56-439b-b1fd-ca9576ffdae4 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b.73b92201-0335-4af3-8d9a-f5ed2b0a5911 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:41 devstack sudo[90280]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2.b361d4d4-3bf8-418f-85f5-9c942d1988d6" returned: 0 in 0.708s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:41 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a5b440c-8865-40a1-8ae1-09748aec54b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:20:41 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2 {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 19:20:41 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Creating direct copy from snapshot {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 19:20:41 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b4fbe0-a74d-4d43-a27e-71ec7d009106]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:20:41 devstack sudo[90289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b.73b92201-0335-4af3-8d9a-f5ed2b0a5911 Apr 28 19:20:41 devstack sudo[90289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:41 devstack sudo[90291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2 Apr 28 19:20:41 devstack sudo[90291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:42 devstack sudo[90289]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-012111fe-fe56-439b-b1fd-ca9576ffdae4 tempest-GroupSnapshotsTest-2116439637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b.73b92201-0335-4af3-8d9a-f5ed2b0a5911" returned: 0 in 0.724s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-012111fe-fe56-439b-b1fd-ca9576ffdae4 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b.73b92201-0335-4af3-8d9a-f5ed2b0a5911 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:42 devstack sudo[90299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b.73b92201-0335-4af3-8d9a-f5ed2b0a5911 Apr 28 19:20:42 devstack sudo[90299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:42 devstack sudo[90291]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2" returned: 0 in 0.746s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:42 devstack cinder-volume[83863]: DEBUG cinder.utils [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Path /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c3913fd5-3f8c-44fc-814a-9bf2a6c03630 not found in is_blk_device check {{(pid=83863) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 19:20:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c3913fd5-3f8c-44fc-814a-9bf2a6c03630 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:42 devstack sudo[90301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c3913fd5-3f8c-44fc-814a-9bf2a6c03630 Apr 28 19:20:42 devstack sudo[90301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:43 devstack sudo[90299]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-012111fe-fe56-439b-b1fd-ca9576ffdae4 tempest-GroupSnapshotsTest-2116439637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b.73b92201-0335-4af3-8d9a-f5ed2b0a5911" returned: 0 in 0.640s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:43 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-012111fe-fe56-439b-b1fd-ca9576ffdae4 tempest-GroupSnapshotsTest-2116439637 None] Lock "cinder-quobyte-73b92201-0335-4af3-8d9a-f5ed2b0a5911" released by "_delete_snapshot" :: held 2.983s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:20:43 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-012111fe-fe56-439b-b1fd-ca9576ffdae4 tempest-GroupSnapshotsTest-2116439637 None] Lock "cinder-quobyte-fa9c9017-ed4c-4025-b87b-148737ffa45b" released by "delete_snapshot" :: held 3.019s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:20:43 devstack cinder-volume[83863]: WARNING cinder.quota [None req-012111fe-fe56-439b-b1fd-ca9576ffdae4 tempest-GroupSnapshotsTest-2116439637 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2024518117 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2024518117, it is now deprecated. Please use the default quota class for default quota. Apr 28 19:20:43 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-012111fe-fe56-439b-b1fd-ca9576ffdae4 tempest-GroupSnapshotsTest-2116439637 None] Created reservations ['9eb9079a-b585-4cd6-a066-011d0a71194b', '4d8ad35c-8417-4a0d-b813-23f09b7d9735', 'd83b0fcb-5df8-4d1c-9946-e9e8a0d1ce28', 'a5039177-b49b-4111-b04c-3b8b4aa926d3'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:20:43 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-012111fe-fe56-439b-b1fd-ca9576ffdae4 tempest-GroupSnapshotsTest-2116439637 None] group_snapshot 9ccfd57b-e351-4b57-b88a-43838a0c7785: deleted successfully Apr 28 19:20:43 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c7710e12-7a49-4e23-b73c-10fe483897e5 tempest-GroupSnapshotsTest-2116439637 None] Acquiring lock "cinder-quobyte-fa9c9017-ed4c-4025-b87b-148737ffa45b" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:20:43 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c7710e12-7a49-4e23-b73c-10fe483897e5 tempest-GroupSnapshotsTest-2116439637 None] Lock "cinder-quobyte-fa9c9017-ed4c-4025-b87b-148737ffa45b" acquired by "delete_volume" :: waited 0.035s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:20:44 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff3b690-3590-42c9-8c69-cf6a3a30d2b6]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:20:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c7710e12-7a49-4e23-b73c-10fe483897e5 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:44 devstack sudo[90315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b Apr 28 19:20:44 devstack sudo[90315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:45 devstack sudo[90315]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c7710e12-7a49-4e23-b73c-10fe483897e5 tempest-GroupSnapshotsTest-2116439637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b" returned: 0 in 1.611s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c7710e12-7a49-4e23-b73c-10fe483897e5 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:45 devstack sudo[90321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b Apr 28 19:20:45 devstack sudo[90321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:47 devstack sudo[90321]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c7710e12-7a49-4e23-b73c-10fe483897e5 tempest-GroupSnapshotsTest-2116439637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fa9c9017-ed4c-4025-b87b-148737ffa45b" returned: 0 in 1.455s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c7710e12-7a49-4e23-b73c-10fe483897e5 tempest-GroupSnapshotsTest-2116439637 None] Lock "cinder-quobyte-fa9c9017-ed4c-4025-b87b-148737ffa45b" released by "delete_volume" :: held 3.205s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:20:47 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-c7710e12-7a49-4e23-b73c-10fe483897e5 tempest-GroupSnapshotsTest-2116439637 None] Created reservations ['5b23e0b2-4b7d-4ff1-bd67-2858c9f6a4be'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:20:47 devstack cinder-volume[83863]: WARNING cinder.db.sqlalchemy.api [None req-c7710e12-7a49-4e23-b73c-10fe483897e5 tempest-GroupSnapshotsTest-2116439637 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-2024518117'] Apr 28 19:20:47 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-c7710e12-7a49-4e23-b73c-10fe483897e5 tempest-GroupSnapshotsTest-2116439637 None] Created reservations ['d0fdb5b9-d27e-4983-9e79-71f932366ad1', 'e5f2d635-9755-499f-be8a-1c6eb52c9968', 'e4de487c-9840-421c-8694-2f30a0f957dc', 'd4a1d01f-9520-4d59-9cad-e6c24cf1e043'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:20:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c7710e12-7a49-4e23-b73c-10fe483897e5 tempest-GroupSnapshotsTest-2116439637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:20:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c7710e12-7a49-4e23-b73c-10fe483897e5 tempest-GroupSnapshotsTest-2116439637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:20:47 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c7710e12-7a49-4e23-b73c-10fe483897e5 tempest-GroupSnapshotsTest-2116439637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:20:47 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c7710e12-7a49-4e23-b73c-10fe483897e5 tempest-GroupSnapshotsTest-2116439637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:20:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c7710e12-7a49-4e23-b73c-10fe483897e5 tempest-GroupSnapshotsTest-2116439637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:20:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c7710e12-7a49-4e23-b73c-10fe483897e5 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:47 devstack sudo[90331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:20:47 devstack sudo[90331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:47 devstack sudo[90301]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c3913fd5-3f8c-44fc-814a-9bf2a6c03630" returned: 0 in 5.386s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:48 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[26891493-c52f-4328-b33d-375c8f7cfc69]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:20:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:48 devstack sudo[90333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2 Apr 28 19:20:48 devstack sudo[90333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:48 devstack sudo[90331]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c7710e12-7a49-4e23-b73c-10fe483897e5 tempest-GroupSnapshotsTest-2116439637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.682s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:48 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-c7710e12-7a49-4e23-b73c-10fe483897e5 tempest-GroupSnapshotsTest-2116439637 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:20:48 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-c7710e12-7a49-4e23-b73c-10fe483897e5 tempest-GroupSnapshotsTest-2116439637 None] Delete group completed successfully. Apr 28 19:20:48 devstack sudo[90333]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2" returned: 0 in 0.914s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:48 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Image conversion details: src /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2, size 1024.00 MB, duration 5.39 sec, destination /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c3913fd5-3f8c-44fc-814a-9bf2a6c03630 {{(pid=83863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 19:20:48 devstack cinder-volume[83863]: INFO cinder.image.image_utils [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Converted 1024.00 MB image at 190.07 MB/s Apr 28 19:20:48 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c3913fd5-3f8c-44fc-814a-9bf2a6c03630 is being set with open permissions: ugo+rw Apr 28 19:20:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c3913fd5-3f8c-44fc-814a-9bf2a6c03630 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:48 devstack sudo[90340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c3913fd5-3f8c-44fc-814a-9bf2a6c03630 Apr 28 19:20:48 devstack sudo[90340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:49 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:SELECT=87,cinder:UPDATE=107,cinder:INSERT=27,cinder:DELETE=8 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 19:20:49 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-acf95c7b-ee4b-4615-a4b1-c27f094f9827 tempest-GroupSnapshotsTest-2116439637 None] Group tempest-GroupSnapshotsTest-Group-1678060885: creating Apr 28 19:20:49 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:UPDATE=99,cinder:SELECT=92,cinder:INSERT=21,cinder:DELETE=5 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 19:20:49 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-acf95c7b-ee4b-4615-a4b1-c27f094f9827 tempest-GroupSnapshotsTest-2116439637 None] Group tempest-GroupSnapshotsTest-Group-1678060885: created successfully Apr 28 19:20:49 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-acf95c7b-ee4b-4615-a4b1-c27f094f9827 tempest-GroupSnapshotsTest-2116439637 None] Create group completed successfully. Apr 28 19:20:49 devstack sudo[90340]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c3913fd5-3f8c-44fc-814a-9bf2a6c03630" returned: 0 in 0.630s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:49 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Lock "cinder-quobyte-c3913fd5-3f8c-44fc-814a-9bf2a6c03630" released by "_copy_volume_from_snapshot" :: held 8.475s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:20:49 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Acquiring lock "cinder-quobyte-b361d4d4-3bf8-418f-85f5-9c942d1988d6" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:20:49 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Lock "cinder-quobyte-b361d4d4-3bf8-418f-85f5-9c942d1988d6" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:20:49 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Deleting offline snapshot b361d4d4-3bf8-418f-85f5-9c942d1988d6 of volume 2a5b440c-8865-40a1-8ae1-09748aec54b2 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 19:20:49 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] snapshot_file for this snap is: volume-2a5b440c-8865-40a1-8ae1-09748aec54b2.b361d4d4-3bf8-418f-85f5-9c942d1988d6 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 19:20:49 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77a7d1a-e6bc-4a10-8b8c-f96632e9121f]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:20:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2.b361d4d4-3bf8-418f-85f5-9c942d1988d6 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:49 devstack sudo[90343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2.b361d4d4-3bf8-418f-85f5-9c942d1988d6 Apr 28 19:20:49 devstack sudo[90343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:50 devstack sudo[90343]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2.b361d4d4-3bf8-418f-85f5-9c942d1988d6" returned: 0 in 0.723s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:50 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a5b440c-8865-40a1-8ae1-09748aec54b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:20:50 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a78dc6-b750-46c5-8281-62f1f88d6752]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:20:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:50 devstack sudo[90348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2 Apr 28 19:20:50 devstack sudo[90348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:50 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-94b0b2e6-cd16-4c6b-9f6a-f0238264758f tempest-GroupSnapshotsTest-2116439637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:20:50 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-94b0b2e6-cd16-4c6b-9f6a-f0238264758f tempest-GroupSnapshotsTest-2116439637 None] Flow 'volume_create_manager' (29b69082-e33a-47e5-893d-7d33cbd51b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:20:50 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-94b0b2e6-cd16-4c6b-9f6a-f0238264758f tempest-GroupSnapshotsTest-2116439637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21c39aad-3565-4467-b2a0-a6d99a8e58cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:50 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-94b0b2e6-cd16-4c6b-9f6a-f0238264758f tempest-GroupSnapshotsTest-2116439637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21c39aad-3565-4467-b2a0-a6d99a8e58cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:20:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-865058733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d83e55a0-a47e-4c74-9551-7a7325e7d3cf,host='devstack@QuobyteHD#QuobyteHD',id=b2905753-39b2-4f3d-a483-0f4d803fa636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e401e9fc3544a1d944049a2dd4e5750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:20:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:20:50Z,use_quota=True,user_id='f9e5c409ae3c4e69a21e97e35ff5de19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed6a695a-d6b5-474e-9f82-8528a91423c1),volume_type_id=ed6a695a-d6b5-474e-9f82-8528a91423c1)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:50 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-94b0b2e6-cd16-4c6b-9f6a-f0238264758f tempest-GroupSnapshotsTest-2116439637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (282bc201-720b-4510-aaad-e0bc6b5e18da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:50 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-94b0b2e6-cd16-4c6b-9f6a-f0238264758f tempest-GroupSnapshotsTest-2116439637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (282bc201-720b-4510-aaad-e0bc6b5e18da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:50 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-94b0b2e6-cd16-4c6b-9f6a-f0238264758f tempest-GroupSnapshotsTest-2116439637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dde8fc59-ba15-43e3-bb8a-99bc23e85d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:50 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-94b0b2e6-cd16-4c6b-9f6a-f0238264758f tempest-GroupSnapshotsTest-2116439637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dde8fc59-ba15-43e3-bb8a-99bc23e85d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2905753-39b2-4f3d-a483-0f4d803fa636', 'volume_name': 'volume-b2905753-39b2-4f3d-a483-0f4d803fa636', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:50 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-94b0b2e6-cd16-4c6b-9f6a-f0238264758f tempest-GroupSnapshotsTest-2116439637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be591371-cfd7-47e0-89fb-9082474d3f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:50 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-94b0b2e6-cd16-4c6b-9f6a-f0238264758f tempest-GroupSnapshotsTest-2116439637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be591371-cfd7-47e0-89fb-9082474d3f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:50 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-94b0b2e6-cd16-4c6b-9f6a-f0238264758f tempest-GroupSnapshotsTest-2116439637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdf8e4c1-28de-4863-a029-d3133c9e5bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:50 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-94b0b2e6-cd16-4c6b-9f6a-f0238264758f tempest-GroupSnapshotsTest-2116439637 None] Volume b2905753-39b2-4f3d-a483-0f4d803fa636: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2905753-39b2-4f3d-a483-0f4d803fa636', 'volume_size': 1} Apr 28 19:20:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-94b0b2e6-cd16-4c6b-9f6a-f0238264758f tempest-GroupSnapshotsTest-2116439637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:20:51 devstack sudo[90348]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2" returned: 0 in 0.738s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2.b361d4d4-3bf8-418f-85f5-9c942d1988d6 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:51 devstack sudo[90356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2.b361d4d4-3bf8-418f-85f5-9c942d1988d6 Apr 28 19:20:51 devstack sudo[90356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:51 devstack sudo[90356]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2.b361d4d4-3bf8-418f-85f5-9c942d1988d6" returned: 0 in 0.695s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2.b361d4d4-3bf8-418f-85f5-9c942d1988d6 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:51 devstack sudo[90361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2.b361d4d4-3bf8-418f-85f5-9c942d1988d6 Apr 28 19:20:51 devstack sudo[90361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:52 devstack sudo[90361]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2.b361d4d4-3bf8-418f-85f5-9c942d1988d6" returned: 0 in 0.588s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Lock "cinder-quobyte-b361d4d4-3bf8-418f-85f5-9c942d1988d6" released by "_delete_snapshot" :: held 2.831s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:20:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.531s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:20:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b4300599-13ae-40ac-80c0-81d6b950b5e7 tempest-VolumesActionsTest-1227654161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.826s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:20:52 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b4300599-13ae-40ac-80c0-81d6b950b5e7 tempest-VolumesActionsTest-1227654161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2131486623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56d5a519-fa6a-4743-9f61-abb8c0e3cfc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38e8856c75104814bef706d799fcb4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:20:32Z,use_quota=True,user_id='846797cf18734e7abb64f3e0f0e6c573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:20:52 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-b4300599-13ae-40ac-80c0-81d6b950b5e7 tempest-VolumesActionsTest-1227654161 None] Creating volume 56d5a519-fa6a-4743-9f61-abb8c0e3cfc4 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:20:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b4300599-13ae-40ac-80c0-81d6b950b5e7 tempest-VolumesActionsTest-1227654161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:20:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b4300599-13ae-40ac-80c0-81d6b950b5e7 tempest-VolumesActionsTest-1227654161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:20:52 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b4300599-13ae-40ac-80c0-81d6b950b5e7 tempest-VolumesActionsTest-1227654161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:20:52 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b4300599-13ae-40ac-80c0-81d6b950b5e7 tempest-VolumesActionsTest-1227654161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:20:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b4300599-13ae-40ac-80c0-81d6b950b5e7 tempest-VolumesActionsTest-1227654161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:20:52 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b4300599-13ae-40ac-80c0-81d6b950b5e7 tempest-VolumesActionsTest-1227654161 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:20:52 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-b4300599-13ae-40ac-80c0-81d6b950b5e7 tempest-VolumesActionsTest-1227654161 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:20:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b4300599-13ae-40ac-80c0-81d6b950b5e7 tempest-VolumesActionsTest-1227654161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-56d5a519-fa6a-4743-9f61-abb8c0e3cfc4 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef552cb7-d3af-4c40-b0d3-55f207cd4217) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3913fd5-3f8c-44fc-814a-9bf2a6c03630', 'volume_size': 2, 'source_volid': '2a5b440c-8865-40a1-8ae1-09748aec54b2', 'source_volstatus': 'available'}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:52 devstack sudo[90364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-56d5a519-fa6a-4743-9f61-abb8c0e3cfc4 1073741824 Apr 28 19:20:52 devstack sudo[90364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f897909b-6040-416b-a9a4-e40569c12d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:52 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Volume volume-c3913fd5-3f8c-44fc-814a-9bf2a6c03630 (c3913fd5-3f8c-44fc-814a-9bf2a6c03630): created successfully Apr 28 19:20:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f897909b-6040-416b-a9a4-e40569c12d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Flow 'volume_create_manager' (dd3dc469-6d0d-4571-9117-b8c552708440) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:20:52 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-3d147380-5291-452b-81e1-5e7dd3abe616 tempest-VolumesCloneTest-48730616 None] Created volume successfully. Apr 28 19:20:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-32649158-e759-4c4d-a88c-162d8c531750 tempest-VolumesCloneTest-48730616 None] Acquiring lock "cinder-c3913fd5-3f8c-44fc-814a-9bf2a6c03630-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:20:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-32649158-e759-4c4d-a88c-162d8c531750 tempest-VolumesCloneTest-48730616 None] Lock "cinder-c3913fd5-3f8c-44fc-814a-9bf2a6c03630-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:20:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-32649158-e759-4c4d-a88c-162d8c531750 tempest-VolumesCloneTest-48730616 None] Acquiring lock "cinder-quobyte-c3913fd5-3f8c-44fc-814a-9bf2a6c03630" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:20:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-32649158-e759-4c4d-a88c-162d8c531750 tempest-VolumesCloneTest-48730616 None] Lock "cinder-quobyte-c3913fd5-3f8c-44fc-814a-9bf2a6c03630" acquired by "delete_volume" :: waited 0.022s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:20:52 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27f9b05-48c8-40de-83d7-7c59aee7bcd8]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:20:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-32649158-e759-4c4d-a88c-162d8c531750 tempest-VolumesCloneTest-48730616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c3913fd5-3f8c-44fc-814a-9bf2a6c03630 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:53 devstack sudo[90369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c3913fd5-3f8c-44fc-814a-9bf2a6c03630 Apr 28 19:20:53 devstack sudo[90369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:53 devstack sudo[90364]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b4300599-13ae-40ac-80c0-81d6b950b5e7 tempest-VolumesActionsTest-1227654161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-56d5a519-fa6a-4743-9f61-abb8c0e3cfc4 1073741824" returned: 0 in 0.786s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b4300599-13ae-40ac-80c0-81d6b950b5e7 tempest-VolumesActionsTest-1227654161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-56d5a519-fa6a-4743-9f61-abb8c0e3cfc4 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:53 devstack sudo[90371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-56d5a519-fa6a-4743-9f61-abb8c0e3cfc4 Apr 28 19:20:53 devstack sudo[90371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:53 devstack sudo[90369]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-32649158-e759-4c4d-a88c-162d8c531750 tempest-VolumesCloneTest-48730616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c3913fd5-3f8c-44fc-814a-9bf2a6c03630" returned: 0 in 0.730s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-32649158-e759-4c4d-a88c-162d8c531750 tempest-VolumesCloneTest-48730616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c3913fd5-3f8c-44fc-814a-9bf2a6c03630 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:53 devstack sudo[90376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c3913fd5-3f8c-44fc-814a-9bf2a6c03630 Apr 28 19:20:53 devstack sudo[90376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:53 devstack sudo[90371]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b4300599-13ae-40ac-80c0-81d6b950b5e7 tempest-VolumesActionsTest-1227654161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-56d5a519-fa6a-4743-9f61-abb8c0e3cfc4" returned: 0 in 0.604s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:53 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b4300599-13ae-40ac-80c0-81d6b950b5e7 tempest-VolumesActionsTest-1227654161 None] <== create_volume: return (1430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:20:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b4300599-13ae-40ac-80c0-81d6b950b5e7 tempest-VolumesActionsTest-1227654161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.433s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:20:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-94b0b2e6-cd16-4c6b-9f6a-f0238264758f tempest-GroupSnapshotsTest-2116439637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.236s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:20:53 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-94b0b2e6-cd16-4c6b-9f6a-f0238264758f tempest-GroupSnapshotsTest-2116439637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d83e55a0-a47e-4c74-9551-7a7325e7d3cf,created_at=2026-04-28T17:20:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-865058733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d83e55a0-a47e-4c74-9551-7a7325e7d3cf,host='devstack@QuobyteHD#QuobyteHD',id=b2905753-39b2-4f3d-a483-0f4d803fa636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e401e9fc3544a1d944049a2dd4e5750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:20:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:20:50Z,use_quota=True,user_id='f9e5c409ae3c4e69a21e97e35ff5de19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed6a695a-d6b5-474e-9f82-8528a91423c1),volume_type_id=ed6a695a-d6b5-474e-9f82-8528a91423c1)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:20:53 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-94b0b2e6-cd16-4c6b-9f6a-f0238264758f tempest-GroupSnapshotsTest-2116439637 None] Creating volume b2905753-39b2-4f3d-a483-0f4d803fa636 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:20:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-94b0b2e6-cd16-4c6b-9f6a-f0238264758f tempest-GroupSnapshotsTest-2116439637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:20:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-94b0b2e6-cd16-4c6b-9f6a-f0238264758f tempest-GroupSnapshotsTest-2116439637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:20:53 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-94b0b2e6-cd16-4c6b-9f6a-f0238264758f tempest-GroupSnapshotsTest-2116439637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:20:53 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-94b0b2e6-cd16-4c6b-9f6a-f0238264758f tempest-GroupSnapshotsTest-2116439637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:20:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-94b0b2e6-cd16-4c6b-9f6a-f0238264758f tempest-GroupSnapshotsTest-2116439637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:20:53 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-94b0b2e6-cd16-4c6b-9f6a-f0238264758f tempest-GroupSnapshotsTest-2116439637 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:20:53 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-94b0b2e6-cd16-4c6b-9f6a-f0238264758f tempest-GroupSnapshotsTest-2116439637 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:20:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-94b0b2e6-cd16-4c6b-9f6a-f0238264758f tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b2905753-39b2-4f3d-a483-0f4d803fa636 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:53 devstack sudo[90379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b2905753-39b2-4f3d-a483-0f4d803fa636 1073741824 Apr 28 19:20:53 devstack sudo[90379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:53 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b4300599-13ae-40ac-80c0-81d6b950b5e7 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af3c60cf-a47d-4258-94c9-39273bf59888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56d5a519-fa6a-4743-9f61-abb8c0e3cfc4', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:53 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b4300599-13ae-40ac-80c0-81d6b950b5e7 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e762cf5e-247b-4fa3-bd65-d03b1af0dd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:53 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-b4300599-13ae-40ac-80c0-81d6b950b5e7 tempest-VolumesActionsTest-1227654161 None] Volume volume-56d5a519-fa6a-4743-9f61-abb8c0e3cfc4 (56d5a519-fa6a-4743-9f61-abb8c0e3cfc4): created successfully Apr 28 19:20:53 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b4300599-13ae-40ac-80c0-81d6b950b5e7 tempest-VolumesActionsTest-1227654161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e762cf5e-247b-4fa3-bd65-d03b1af0dd6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:53 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b4300599-13ae-40ac-80c0-81d6b950b5e7 tempest-VolumesActionsTest-1227654161 None] Flow 'volume_create_manager' (069206a7-9e9c-4503-8551-731d337129da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:20:53 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-b4300599-13ae-40ac-80c0-81d6b950b5e7 tempest-VolumesActionsTest-1227654161 None] Created volume successfully. Apr 28 19:20:54 devstack sudo[90376]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-32649158-e759-4c4d-a88c-162d8c531750 tempest-VolumesCloneTest-48730616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c3913fd5-3f8c-44fc-814a-9bf2a6c03630" returned: 0 in 0.614s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:54 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-32649158-e759-4c4d-a88c-162d8c531750 tempest-VolumesCloneTest-48730616 None] Lock "cinder-quobyte-c3913fd5-3f8c-44fc-814a-9bf2a6c03630" released by "delete_volume" :: held 1.390s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:20:54 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-32649158-e759-4c4d-a88c-162d8c531750 tempest-VolumesCloneTest-48730616 None] Created reservations ['29dabebd-4179-4796-9866-b698117b94f3', '5a899d23-b5e9-4af6-a72b-6e5527ff7f6d', '77ad79ff-b016-42ed-82a2-54c4e7891f93', 'f994b211-7537-4aa6-9384-1f43d255cc44'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:20:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-32649158-e759-4c4d-a88c-162d8c531750 tempest-VolumesCloneTest-48730616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:20:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-32649158-e759-4c4d-a88c-162d8c531750 tempest-VolumesCloneTest-48730616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:20:54 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-32649158-e759-4c4d-a88c-162d8c531750 tempest-VolumesCloneTest-48730616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:20:54 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-32649158-e759-4c4d-a88c-162d8c531750 tempest-VolumesCloneTest-48730616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:20:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-32649158-e759-4c4d-a88c-162d8c531750 tempest-VolumesCloneTest-48730616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:20:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-32649158-e759-4c4d-a88c-162d8c531750 tempest-VolumesCloneTest-48730616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:54 devstack sudo[90385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:20:54 devstack sudo[90385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:54 devstack sudo[90379]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-94b0b2e6-cd16-4c6b-9f6a-f0238264758f tempest-GroupSnapshotsTest-2116439637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b2905753-39b2-4f3d-a483-0f4d803fa636 1073741824" returned: 0 in 0.891s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-94b0b2e6-cd16-4c6b-9f6a-f0238264758f tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b2905753-39b2-4f3d-a483-0f4d803fa636 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:54 devstack sudo[90388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b2905753-39b2-4f3d-a483-0f4d803fa636 Apr 28 19:20:54 devstack sudo[90388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:55 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5c6645bc-5046-4eed-85b4-b3c9aba71013 tempest-VolumesActionsTest-1227654161 None] Acquiring lock "cinder-56d5a519-fa6a-4743-9f61-abb8c0e3cfc4-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:20:55 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5c6645bc-5046-4eed-85b4-b3c9aba71013 tempest-VolumesActionsTest-1227654161 None] Lock "cinder-56d5a519-fa6a-4743-9f61-abb8c0e3cfc4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:20:55 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5c6645bc-5046-4eed-85b4-b3c9aba71013 tempest-VolumesActionsTest-1227654161 None] Acquiring lock "cinder-quobyte-56d5a519-fa6a-4743-9f61-abb8c0e3cfc4" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:20:55 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5c6645bc-5046-4eed-85b4-b3c9aba71013 tempest-VolumesActionsTest-1227654161 None] Lock "cinder-quobyte-56d5a519-fa6a-4743-9f61-abb8c0e3cfc4" acquired by "delete_volume" :: waited 0.026s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:20:55 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a8f747-b9b1-4ab2-9a59-0cf8b31a819a]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:20:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5c6645bc-5046-4eed-85b4-b3c9aba71013 tempest-VolumesActionsTest-1227654161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-56d5a519-fa6a-4743-9f61-abb8c0e3cfc4 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:55 devstack sudo[90385]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-32649158-e759-4c4d-a88c-162d8c531750 tempest-VolumesCloneTest-48730616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.682s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:55 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-32649158-e759-4c4d-a88c-162d8c531750 tempest-VolumesCloneTest-48730616 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:20:55 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-32649158-e759-4c4d-a88c-162d8c531750 tempest-VolumesCloneTest-48730616 None] Deleted volume successfully. Apr 28 19:20:55 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-32649158-e759-4c4d-a88c-162d8c531750 tempest-VolumesCloneTest-48730616 None] Lock "cinder-c3913fd5-3f8c-44fc-814a-9bf2a6c03630-delete_volume" released by "delete_volume" :: held 2.293s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:20:55 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d36df528-89ba-4b7d-a7a8-c940c22e1a0b tempest-VolumesCloneTest-48730616 None] Acquiring lock "cinder-2a5b440c-8865-40a1-8ae1-09748aec54b2-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:20:55 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d36df528-89ba-4b7d-a7a8-c940c22e1a0b tempest-VolumesCloneTest-48730616 None] Lock "cinder-2a5b440c-8865-40a1-8ae1-09748aec54b2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:20:55 devstack sudo[90391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-56d5a519-fa6a-4743-9f61-abb8c0e3cfc4 Apr 28 19:20:55 devstack sudo[90391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:55 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d36df528-89ba-4b7d-a7a8-c940c22e1a0b tempest-VolumesCloneTest-48730616 None] Acquiring lock "cinder-quobyte-2a5b440c-8865-40a1-8ae1-09748aec54b2" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:20:55 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d36df528-89ba-4b7d-a7a8-c940c22e1a0b tempest-VolumesCloneTest-48730616 None] Lock "cinder-quobyte-2a5b440c-8865-40a1-8ae1-09748aec54b2" acquired by "delete_volume" :: waited 0.019s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:20:55 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefe88fc-76d9-4396-aeba-faaddc1e7d18]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:20:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d36df528-89ba-4b7d-a7a8-c940c22e1a0b tempest-VolumesCloneTest-48730616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:55 devstack sudo[90393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2 Apr 28 19:20:55 devstack sudo[90393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:55 devstack sudo[90388]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-94b0b2e6-cd16-4c6b-9f6a-f0238264758f tempest-GroupSnapshotsTest-2116439637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b2905753-39b2-4f3d-a483-0f4d803fa636" returned: 0 in 0.702s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:55 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-94b0b2e6-cd16-4c6b-9f6a-f0238264758f tempest-GroupSnapshotsTest-2116439637 None] <== create_volume: return (1635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:20:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-94b0b2e6-cd16-4c6b-9f6a-f0238264758f tempest-GroupSnapshotsTest-2116439637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.641s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:20:55 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-94b0b2e6-cd16-4c6b-9f6a-f0238264758f tempest-GroupSnapshotsTest-2116439637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdf8e4c1-28de-4863-a029-d3133c9e5bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2905753-39b2-4f3d-a483-0f4d803fa636', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:55 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-94b0b2e6-cd16-4c6b-9f6a-f0238264758f tempest-GroupSnapshotsTest-2116439637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7e4a5b5-d3a0-49d3-a062-dde98da98277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:55 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-94b0b2e6-cd16-4c6b-9f6a-f0238264758f tempest-GroupSnapshotsTest-2116439637 None] Volume volume-b2905753-39b2-4f3d-a483-0f4d803fa636 (b2905753-39b2-4f3d-a483-0f4d803fa636): created successfully Apr 28 19:20:55 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-94b0b2e6-cd16-4c6b-9f6a-f0238264758f tempest-GroupSnapshotsTest-2116439637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7e4a5b5-d3a0-49d3-a062-dde98da98277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:55 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-94b0b2e6-cd16-4c6b-9f6a-f0238264758f tempest-GroupSnapshotsTest-2116439637 None] Flow 'volume_create_manager' (29b69082-e33a-47e5-893d-7d33cbd51b7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:20:55 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-94b0b2e6-cd16-4c6b-9f6a-f0238264758f tempest-GroupSnapshotsTest-2116439637 None] Created volume successfully. Apr 28 19:20:55 devstack sudo[90391]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5c6645bc-5046-4eed-85b4-b3c9aba71013 tempest-VolumesActionsTest-1227654161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-56d5a519-fa6a-4743-9f61-abb8c0e3cfc4" returned: 0 in 0.795s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5c6645bc-5046-4eed-85b4-b3c9aba71013 tempest-VolumesActionsTest-1227654161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-56d5a519-fa6a-4743-9f61-abb8c0e3cfc4 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:55 devstack sudo[90399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-56d5a519-fa6a-4743-9f61-abb8c0e3cfc4 Apr 28 19:20:55 devstack sudo[90399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:56 devstack sudo[90393]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d36df528-89ba-4b7d-a7a8-c940c22e1a0b tempest-VolumesCloneTest-48730616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2" returned: 0 in 0.771s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d36df528-89ba-4b7d-a7a8-c940c22e1a0b tempest-VolumesCloneTest-48730616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:56 devstack sudo[90404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2 Apr 28 19:20:56 devstack sudo[90404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:56 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-2044e40b-2841-4daf-896d-79af4d824e95 tempest-GroupSnapshotsTest-2116439637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:20:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2044e40b-2841-4daf-896d-79af4d824e95 tempest-GroupSnapshotsTest-2116439637 None] Flow 'volume_create_manager' (3247d302-fa37-4170-b751-67f8faae6f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:20:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2044e40b-2841-4daf-896d-79af4d824e95 tempest-GroupSnapshotsTest-2116439637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e650369-0ce9-46e7-b104-2771becc97b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2044e40b-2841-4daf-896d-79af4d824e95 tempest-GroupSnapshotsTest-2116439637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e650369-0ce9-46e7-b104-2771becc97b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1698251233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d83e55a0-a47e-4c74-9551-7a7325e7d3cf,host='devstack@QuobyteHD#QuobyteHD',id=1ed61aed-b4c8-4374-bcc7-058abea6ab3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e401e9fc3544a1d944049a2dd4e5750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:20:56Z,use_quota=True,user_id='f9e5c409ae3c4e69a21e97e35ff5de19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed6a695a-d6b5-474e-9f82-8528a91423c1),volume_type_id=ed6a695a-d6b5-474e-9f82-8528a91423c1)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2044e40b-2841-4daf-896d-79af4d824e95 tempest-GroupSnapshotsTest-2116439637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1db61fb4-8f52-432e-a3a4-5d7191e45d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:56 devstack sudo[90399]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2044e40b-2841-4daf-896d-79af4d824e95 tempest-GroupSnapshotsTest-2116439637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1db61fb4-8f52-432e-a3a4-5d7191e45d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2044e40b-2841-4daf-896d-79af4d824e95 tempest-GroupSnapshotsTest-2116439637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a015c67d-6705-43d3-87e2-e3825bba7e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2044e40b-2841-4daf-896d-79af4d824e95 tempest-GroupSnapshotsTest-2116439637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a015c67d-6705-43d3-87e2-e3825bba7e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ed61aed-b4c8-4374-bcc7-058abea6ab3e', 'volume_name': 'volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2044e40b-2841-4daf-896d-79af4d824e95 tempest-GroupSnapshotsTest-2116439637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9c632e9-c4cb-4e35-9afa-73d73b50d91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2044e40b-2841-4daf-896d-79af4d824e95 tempest-GroupSnapshotsTest-2116439637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9c632e9-c4cb-4e35-9afa-73d73b50d91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2044e40b-2841-4daf-896d-79af4d824e95 tempest-GroupSnapshotsTest-2116439637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcf1145e-d7d2-4876-a43d-80bd62dbc584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:56 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-2044e40b-2841-4daf-896d-79af4d824e95 tempest-GroupSnapshotsTest-2116439637 None] Volume 1ed61aed-b4c8-4374-bcc7-058abea6ab3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e', 'volume_size': 1} Apr 28 19:20:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2044e40b-2841-4daf-896d-79af4d824e95 tempest-GroupSnapshotsTest-2116439637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:20:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2044e40b-2841-4daf-896d-79af4d824e95 tempest-GroupSnapshotsTest-2116439637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:20:56 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2044e40b-2841-4daf-896d-79af4d824e95 tempest-GroupSnapshotsTest-2116439637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d83e55a0-a47e-4c74-9551-7a7325e7d3cf,created_at=2026-04-28T17:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1698251233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d83e55a0-a47e-4c74-9551-7a7325e7d3cf,host='devstack@QuobyteHD#QuobyteHD',id=1ed61aed-b4c8-4374-bcc7-058abea6ab3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e401e9fc3544a1d944049a2dd4e5750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:20:56Z,use_quota=True,user_id='f9e5c409ae3c4e69a21e97e35ff5de19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed6a695a-d6b5-474e-9f82-8528a91423c1),volume_type_id=ed6a695a-d6b5-474e-9f82-8528a91423c1)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:20:56 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-2044e40b-2841-4daf-896d-79af4d824e95 tempest-GroupSnapshotsTest-2116439637 None] Creating volume 1ed61aed-b4c8-4374-bcc7-058abea6ab3e {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:20:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2044e40b-2841-4daf-896d-79af4d824e95 tempest-GroupSnapshotsTest-2116439637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:20:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2044e40b-2841-4daf-896d-79af4d824e95 tempest-GroupSnapshotsTest-2116439637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:20:56 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2044e40b-2841-4daf-896d-79af4d824e95 tempest-GroupSnapshotsTest-2116439637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:20:56 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2044e40b-2841-4daf-896d-79af4d824e95 tempest-GroupSnapshotsTest-2116439637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:20:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2044e40b-2841-4daf-896d-79af4d824e95 tempest-GroupSnapshotsTest-2116439637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:20:56 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2044e40b-2841-4daf-896d-79af4d824e95 tempest-GroupSnapshotsTest-2116439637 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:20:56 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-2044e40b-2841-4daf-896d-79af4d824e95 tempest-GroupSnapshotsTest-2116439637 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:20:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2044e40b-2841-4daf-896d-79af4d824e95 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5c6645bc-5046-4eed-85b4-b3c9aba71013 tempest-VolumesActionsTest-1227654161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-56d5a519-fa6a-4743-9f61-abb8c0e3cfc4" returned: 0 in 0.717s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:56 devstack sudo[90407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e 1073741824 Apr 28 19:20:56 devstack sudo[90407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:56 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5c6645bc-5046-4eed-85b4-b3c9aba71013 tempest-VolumesActionsTest-1227654161 None] Lock "cinder-quobyte-56d5a519-fa6a-4743-9f61-abb8c0e3cfc4" released by "delete_volume" :: held 1.568s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:20:56 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-5c6645bc-5046-4eed-85b4-b3c9aba71013 tempest-VolumesActionsTest-1227654161 None] Created reservations ['f6ceefd5-9302-481a-9bcd-f57bead92c6b', '19e778d1-8f0e-4219-8959-d23198fd76b6', 'd6a35d62-c58a-4da1-a8df-450ae7591ec6', 'de6866f7-5325-4c2f-93c9-75b30289a683'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:20:56 devstack sudo[90404]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d36df528-89ba-4b7d-a7a8-c940c22e1a0b tempest-VolumesCloneTest-48730616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2a5b440c-8865-40a1-8ae1-09748aec54b2" returned: 0 in 0.638s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5c6645bc-5046-4eed-85b4-b3c9aba71013 tempest-VolumesActionsTest-1227654161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:20:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5c6645bc-5046-4eed-85b4-b3c9aba71013 tempest-VolumesActionsTest-1227654161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:20:56 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5c6645bc-5046-4eed-85b4-b3c9aba71013 tempest-VolumesActionsTest-1227654161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:20:56 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5c6645bc-5046-4eed-85b4-b3c9aba71013 tempest-VolumesActionsTest-1227654161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:20:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5c6645bc-5046-4eed-85b4-b3c9aba71013 tempest-VolumesActionsTest-1227654161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:20:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5c6645bc-5046-4eed-85b4-b3c9aba71013 tempest-VolumesActionsTest-1227654161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:56 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d36df528-89ba-4b7d-a7a8-c940c22e1a0b tempest-VolumesCloneTest-48730616 None] Lock "cinder-quobyte-2a5b440c-8865-40a1-8ae1-09748aec54b2" released by "delete_volume" :: held 1.483s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:20:56 devstack sudo[90410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:20:56 devstack sudo[90410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:56 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-d36df528-89ba-4b7d-a7a8-c940c22e1a0b tempest-VolumesCloneTest-48730616 None] Created reservations ['344bcba8-904d-46e5-a00f-b50e09ff1239', 'f7d0a9f8-f718-45db-9a1f-22237bc94578', 'c32dfc2c-cb27-48d9-88e9-7f2cae00c00e', '87f19d78-e15c-4696-8d7a-b8b2ccb81483'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:20:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d36df528-89ba-4b7d-a7a8-c940c22e1a0b tempest-VolumesCloneTest-48730616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:20:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d36df528-89ba-4b7d-a7a8-c940c22e1a0b tempest-VolumesCloneTest-48730616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:20:56 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d36df528-89ba-4b7d-a7a8-c940c22e1a0b tempest-VolumesCloneTest-48730616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:20:56 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d36df528-89ba-4b7d-a7a8-c940c22e1a0b tempest-VolumesCloneTest-48730616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:20:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d36df528-89ba-4b7d-a7a8-c940c22e1a0b tempest-VolumesCloneTest-48730616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:20:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d36df528-89ba-4b7d-a7a8-c940c22e1a0b tempest-VolumesCloneTest-48730616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:56 devstack sudo[90412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:20:56 devstack sudo[90412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:57 devstack sudo[90410]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5c6645bc-5046-4eed-85b4-b3c9aba71013 tempest-VolumesActionsTest-1227654161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.630s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:57 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-5c6645bc-5046-4eed-85b4-b3c9aba71013 tempest-VolumesActionsTest-1227654161 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:20:57 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-5c6645bc-5046-4eed-85b4-b3c9aba71013 tempest-VolumesActionsTest-1227654161 None] Deleted volume successfully. Apr 28 19:20:57 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5c6645bc-5046-4eed-85b4-b3c9aba71013 tempest-VolumesActionsTest-1227654161 None] Lock "cinder-56d5a519-fa6a-4743-9f61-abb8c0e3cfc4-delete_volume" released by "delete_volume" :: held 2.452s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:20:57 devstack sudo[90407]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2044e40b-2841-4daf-896d-79af4d824e95 tempest-GroupSnapshotsTest-2116439637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e 1073741824" returned: 0 in 0.945s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:57 devstack sudo[90412]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d36df528-89ba-4b7d-a7a8-c940c22e1a0b tempest-VolumesCloneTest-48730616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.692s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:57 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-d36df528-89ba-4b7d-a7a8-c940c22e1a0b tempest-VolumesCloneTest-48730616 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:20:57 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-d36df528-89ba-4b7d-a7a8-c940c22e1a0b tempest-VolumesCloneTest-48730616 None] Deleted volume successfully. Apr 28 19:20:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2044e40b-2841-4daf-896d-79af4d824e95 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:20:57 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d36df528-89ba-4b7d-a7a8-c940c22e1a0b tempest-VolumesCloneTest-48730616 None] Lock "cinder-2a5b440c-8865-40a1-8ae1-09748aec54b2-delete_volume" released by "delete_volume" :: held 2.413s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:20:57 devstack sudo[90421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e Apr 28 19:20:57 devstack sudo[90421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:20:58 devstack sudo[90421]: pam_unix(sudo:session): session closed for user root Apr 28 19:20:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2044e40b-2841-4daf-896d-79af4d824e95 tempest-GroupSnapshotsTest-2116439637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e" returned: 0 in 0.685s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:20:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2044e40b-2841-4daf-896d-79af4d824e95 tempest-GroupSnapshotsTest-2116439637 None] <== create_volume: return (1688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:20:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2044e40b-2841-4daf-896d-79af4d824e95 tempest-GroupSnapshotsTest-2116439637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.691s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:20:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2044e40b-2841-4daf-896d-79af4d824e95 tempest-GroupSnapshotsTest-2116439637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcf1145e-d7d2-4876-a43d-80bd62dbc584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2044e40b-2841-4daf-896d-79af4d824e95 tempest-GroupSnapshotsTest-2116439637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9129d39c-66e9-436e-9b0b-dd9847918a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:20:58 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-2044e40b-2841-4daf-896d-79af4d824e95 tempest-GroupSnapshotsTest-2116439637 None] Volume volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e (1ed61aed-b4c8-4374-bcc7-058abea6ab3e): created successfully Apr 28 19:20:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2044e40b-2841-4daf-896d-79af4d824e95 tempest-GroupSnapshotsTest-2116439637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9129d39c-66e9-436e-9b0b-dd9847918a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:20:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2044e40b-2841-4daf-896d-79af4d824e95 tempest-GroupSnapshotsTest-2116439637 None] Flow 'volume_create_manager' (3247d302-fa37-4170-b751-67f8faae6f6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:20:58 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-2044e40b-2841-4daf-896d-79af4d824e95 tempest-GroupSnapshotsTest-2116439637 None] Created volume successfully. Apr 28 19:20:59 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-bb644c89-cf31-40df-875a-18a58b14b67e tempest-GroupSnapshotsTest-2116439637 None] Update group completed successfully. Apr 28 19:21:00 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-341949fe-bbbe-4688-93b3-778a140d4f21 tempest-GroupSnapshotsTest-2116439637 None] Update group completed successfully. Apr 28 19:21:00 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f31908a-d7ab-4506-a2b8-d60c0eefb617 tempest-VolumesGetTest-711720961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:21:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2f31908a-d7ab-4506-a2b8-d60c0eefb617 tempest-VolumesGetTest-711720961 None] Flow 'volume_create_manager' (57ee9cb0-ef09-4a0a-9917-97830e67fd23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:21:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2f31908a-d7ab-4506-a2b8-d60c0eefb617 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70ad1c83-989e-4cfe-baab-fd75a0ab160b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2f31908a-d7ab-4506-a2b8-d60c0eefb617 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70ad1c83-989e-4cfe-baab-fd75a0ab160b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1838926710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=085a4b75-1622-4c9f-93bc-1633f56499d4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9b8969a99ceb4c87b83e42ed49dfe036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:21:01Z,use_quota=True,user_id='49def545e71141ef8b767db7c433c4f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2f31908a-d7ab-4506-a2b8-d60c0eefb617 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f17834dc-ab8a-411a-99bc-bb7055171d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2f31908a-d7ab-4506-a2b8-d60c0eefb617 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f17834dc-ab8a-411a-99bc-bb7055171d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2f31908a-d7ab-4506-a2b8-d60c0eefb617 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (719add7d-b51f-49f7-98f8-71dac78c1c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2f31908a-d7ab-4506-a2b8-d60c0eefb617 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (719add7d-b51f-49f7-98f8-71dac78c1c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '085a4b75-1622-4c9f-93bc-1633f56499d4', 'volume_name': 'volume-085a4b75-1622-4c9f-93bc-1633f56499d4', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2f31908a-d7ab-4506-a2b8-d60c0eefb617 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2da47380-0a09-461d-8892-3b20b029ab65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2f31908a-d7ab-4506-a2b8-d60c0eefb617 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2da47380-0a09-461d-8892-3b20b029ab65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2f31908a-d7ab-4506-a2b8-d60c0eefb617 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53b3ec88-f68b-4362-aa2b-60bd3e3d6636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:00 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-2f31908a-d7ab-4506-a2b8-d60c0eefb617 tempest-VolumesGetTest-711720961 None] Volume 085a4b75-1622-4c9f-93bc-1633f56499d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-085a4b75-1622-4c9f-93bc-1633f56499d4', 'volume_size': 1} Apr 28 19:21:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2f31908a-d7ab-4506-a2b8-d60c0eefb617 tempest-VolumesGetTest-711720961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:21:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2f31908a-d7ab-4506-a2b8-d60c0eefb617 tempest-VolumesGetTest-711720961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:21:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2f31908a-d7ab-4506-a2b8-d60c0eefb617 tempest-VolumesGetTest-711720961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1838926710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=085a4b75-1622-4c9f-93bc-1633f56499d4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9b8969a99ceb4c87b83e42ed49dfe036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:21:01Z,use_quota=True,user_id='49def545e71141ef8b767db7c433c4f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:21:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-2f31908a-d7ab-4506-a2b8-d60c0eefb617 tempest-VolumesGetTest-711720961 None] Creating volume 085a4b75-1622-4c9f-93bc-1633f56499d4 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:21:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2f31908a-d7ab-4506-a2b8-d60c0eefb617 tempest-VolumesGetTest-711720961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:21:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2f31908a-d7ab-4506-a2b8-d60c0eefb617 tempest-VolumesGetTest-711720961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:21:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2f31908a-d7ab-4506-a2b8-d60c0eefb617 tempest-VolumesGetTest-711720961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:21:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2f31908a-d7ab-4506-a2b8-d60c0eefb617 tempest-VolumesGetTest-711720961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:21:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2f31908a-d7ab-4506-a2b8-d60c0eefb617 tempest-VolumesGetTest-711720961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:21:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2f31908a-d7ab-4506-a2b8-d60c0eefb617 tempest-VolumesGetTest-711720961 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:21:00 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-2f31908a-d7ab-4506-a2b8-d60c0eefb617 tempest-VolumesGetTest-711720961 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:21:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2f31908a-d7ab-4506-a2b8-d60c0eefb617 tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-085a4b75-1622-4c9f-93bc-1633f56499d4 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:00 devstack sudo[90426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-085a4b75-1622-4c9f-93bc-1633f56499d4 1073741824 Apr 28 19:21:00 devstack sudo[90426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:01 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-1b1eef26-53af-456d-80fa-f353ca9a8764 tempest-GroupSnapshotsTest-2116439637 None] Update group completed successfully. Apr 28 19:21:01 devstack sudo[90426]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2f31908a-d7ab-4506-a2b8-d60c0eefb617 tempest-VolumesGetTest-711720961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-085a4b75-1622-4c9f-93bc-1633f56499d4 1073741824" returned: 0 in 0.887s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2f31908a-d7ab-4506-a2b8-d60c0eefb617 tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-085a4b75-1622-4c9f-93bc-1633f56499d4 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:01 devstack sudo[90433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-085a4b75-1622-4c9f-93bc-1633f56499d4 Apr 28 19:21:01 devstack sudo[90433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:02 devstack sudo[90433]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2f31908a-d7ab-4506-a2b8-d60c0eefb617 tempest-VolumesGetTest-711720961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-085a4b75-1622-4c9f-93bc-1633f56499d4" returned: 0 in 0.621s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:02 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2f31908a-d7ab-4506-a2b8-d60c0eefb617 tempest-VolumesGetTest-711720961 None] <== create_volume: return (1561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:21:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2f31908a-d7ab-4506-a2b8-d60c0eefb617 tempest-VolumesGetTest-711720961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:21:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2f31908a-d7ab-4506-a2b8-d60c0eefb617 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53b3ec88-f68b-4362-aa2b-60bd3e3d6636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-085a4b75-1622-4c9f-93bc-1633f56499d4', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2f31908a-d7ab-4506-a2b8-d60c0eefb617 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a22e7e1-864d-4b04-b7f6-2b0138b43eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:02 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-2f31908a-d7ab-4506-a2b8-d60c0eefb617 tempest-VolumesGetTest-711720961 None] Volume volume-085a4b75-1622-4c9f-93bc-1633f56499d4 (085a4b75-1622-4c9f-93bc-1633f56499d4): created successfully Apr 28 19:21:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2f31908a-d7ab-4506-a2b8-d60c0eefb617 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a22e7e1-864d-4b04-b7f6-2b0138b43eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2f31908a-d7ab-4506-a2b8-d60c0eefb617 tempest-VolumesGetTest-711720961 None] Flow 'volume_create_manager' (57ee9cb0-ef09-4a0a-9917-97830e67fd23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:21:02 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-2f31908a-d7ab-4506-a2b8-d60c0eefb617 tempest-VolumesGetTest-711720961 None] Created volume successfully. Apr 28 19:21:02 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-2be9076f-a7a3-4ce7-8891-0617ae700443 tempest-GroupSnapshotsTest-2116439637 None] Update group completed successfully. Apr 28 19:21:03 devstack cinder-volume[83863]: DEBUG oslo_service.periodic_task [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 28 19:21:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:21:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:21:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:21:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:21:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:21:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:03 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbe113e0-d5b2-4482-bc5f-44d9f84a7b70 tempest-VolumesGetTest-711720961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:21:03 devstack sudo[90437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:21:03 devstack sudo[90437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-bbe113e0-d5b2-4482-bc5f-44d9f84a7b70 tempest-VolumesGetTest-711720961 None] Flow 'volume_create_manager' (28af338b-5a91-4ca0-a1fe-00245b61158d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:21:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-bbe113e0-d5b2-4482-bc5f-44d9f84a7b70 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d1098fb-3659-48bd-a8a6-3533eec75c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-bbe113e0-d5b2-4482-bc5f-44d9f84a7b70 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d1098fb-3659-48bd-a8a6-3533eec75c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:21:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1405887469',display_name='tempest-VolumesGetTest-Volume-122181798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f8b390d-a826-44f8-8ef4-b9522bd9bb78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8969a99ceb4c87b83e42ed49dfe036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:21:03Z,use_quota=True,user_id='49def545e71141ef8b767db7c433c4f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-bbe113e0-d5b2-4482-bc5f-44d9f84a7b70 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b831e692-4e0e-4615-b6f3-58a819e5af92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-bbe113e0-d5b2-4482-bc5f-44d9f84a7b70 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b831e692-4e0e-4615-b6f3-58a819e5af92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-bbe113e0-d5b2-4482-bc5f-44d9f84a7b70 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7d91858-d8cf-4bbf-9a9b-e06002b859ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-bbe113e0-d5b2-4482-bc5f-44d9f84a7b70 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7d91858-d8cf-4bbf-9a9b-e06002b859ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f8b390d-a826-44f8-8ef4-b9522bd9bb78', 'volume_name': 'volume-9f8b390d-a826-44f8-8ef4-b9522bd9bb78', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-bbe113e0-d5b2-4482-bc5f-44d9f84a7b70 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29d51e43-e8f3-4bab-8cd9-0397f10c2903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-bbe113e0-d5b2-4482-bc5f-44d9f84a7b70 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29d51e43-e8f3-4bab-8cd9-0397f10c2903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-bbe113e0-d5b2-4482-bc5f-44d9f84a7b70 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (546d3c9a-4796-45af-a67e-17ac94f0f640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:03 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-bbe113e0-d5b2-4482-bc5f-44d9f84a7b70 tempest-VolumesGetTest-711720961 None] Volume 9f8b390d-a826-44f8-8ef4-b9522bd9bb78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f8b390d-a826-44f8-8ef4-b9522bd9bb78', 'volume_size': 1} Apr 28 19:21:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-bbe113e0-d5b2-4482-bc5f-44d9f84a7b70 tempest-VolumesGetTest-711720961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:21:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-bbe113e0-d5b2-4482-bc5f-44d9f84a7b70 tempest-VolumesGetTest-711720961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:21:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-bbe113e0-d5b2-4482-bc5f-44d9f84a7b70 tempest-VolumesGetTest-711720961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:21:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1405887469',display_name='tempest-VolumesGetTest-Volume-122181798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f8b390d-a826-44f8-8ef4-b9522bd9bb78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8969a99ceb4c87b83e42ed49dfe036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:21:03Z,use_quota=True,user_id='49def545e71141ef8b767db7c433c4f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:21:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-bbe113e0-d5b2-4482-bc5f-44d9f84a7b70 tempest-VolumesGetTest-711720961 None] Creating volume 9f8b390d-a826-44f8-8ef4-b9522bd9bb78 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:21:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-bbe113e0-d5b2-4482-bc5f-44d9f84a7b70 tempest-VolumesGetTest-711720961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:21:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-bbe113e0-d5b2-4482-bc5f-44d9f84a7b70 tempest-VolumesGetTest-711720961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:21:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-bbe113e0-d5b2-4482-bc5f-44d9f84a7b70 tempest-VolumesGetTest-711720961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:21:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-bbe113e0-d5b2-4482-bc5f-44d9f84a7b70 tempest-VolumesGetTest-711720961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:21:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-bbe113e0-d5b2-4482-bc5f-44d9f84a7b70 tempest-VolumesGetTest-711720961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:21:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-bbe113e0-d5b2-4482-bc5f-44d9f84a7b70 tempest-VolumesGetTest-711720961 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:21:03 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-bbe113e0-d5b2-4482-bc5f-44d9f84a7b70 tempest-VolumesGetTest-711720961 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:21:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bbe113e0-d5b2-4482-bc5f-44d9f84a7b70 tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9f8b390d-a826-44f8-8ef4-b9522bd9bb78 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:03 devstack sudo[90439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9f8b390d-a826-44f8-8ef4-b9522bd9bb78 1073741824 Apr 28 19:21:03 devstack sudo[90439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:04 devstack sudo[90437]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:04 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-2c330c24-6eb7-45e2-8cf8-c353bca188d8 tempest-GroupSnapshotsTest-2116439637 None] GroupSnapshot edd641dc-b9df-45c2-af11-a01694afe835: creating. Apr 28 19:21:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.803s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:04 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:21:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2c330c24-6eb7-45e2-8cf8-c353bca188d8 tempest-GroupSnapshotsTest-2116439637 None] Group snapshot edd641dc-b9df-45c2-af11-a01694afe835: creating. {{(pid=83863) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 28 19:21:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2c330c24-6eb7-45e2-8cf8-c353bca188d8 tempest-GroupSnapshotsTest-2116439637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:21:04 devstack sudo[90439]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bbe113e0-d5b2-4482-bc5f-44d9f84a7b70 tempest-VolumesGetTest-711720961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9f8b390d-a826-44f8-8ef4-b9522bd9bb78 1073741824" returned: 0 in 1.062s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bbe113e0-d5b2-4482-bc5f-44d9f84a7b70 tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9f8b390d-a826-44f8-8ef4-b9522bd9bb78 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:04 devstack sudo[90446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9f8b390d-a826-44f8-8ef4-b9522bd9bb78 Apr 28 19:21:04 devstack sudo[90446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:05 devstack sudo[90446]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bbe113e0-d5b2-4482-bc5f-44d9f84a7b70 tempest-VolumesGetTest-711720961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9f8b390d-a826-44f8-8ef4-b9522bd9bb78" returned: 0 in 0.662s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:05 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-bbe113e0-d5b2-4482-bc5f-44d9f84a7b70 tempest-VolumesGetTest-711720961 None] <== create_volume: return (1767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:21:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-bbe113e0-d5b2-4482-bc5f-44d9f84a7b70 tempest-VolumesGetTest-711720961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.769s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:21:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2c330c24-6eb7-45e2-8cf8-c353bca188d8 tempest-GroupSnapshotsTest-2116439637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.048s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:21:05 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-bbe113e0-d5b2-4482-bc5f-44d9f84a7b70 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (546d3c9a-4796-45af-a67e-17ac94f0f640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f8b390d-a826-44f8-8ef4-b9522bd9bb78', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:05 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-bbe113e0-d5b2-4482-bc5f-44d9f84a7b70 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (653b668a-b570-4a61-864d-e5c895acf973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:05 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-2c330c24-6eb7-45e2-8cf8-c353bca188d8 tempest-GroupSnapshotsTest-2116439637 None] Creating offline snapshot 2a96df8b-c46d-470b-af3e-7f8dbb7d9ffa of volume b2905753-39b2-4f3d-a483-0f4d803fa636 {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 19:21:05 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-bbe113e0-d5b2-4482-bc5f-44d9f84a7b70 tempest-VolumesGetTest-711720961 None] Volume volume-9f8b390d-a826-44f8-8ef4-b9522bd9bb78 (9f8b390d-a826-44f8-8ef4-b9522bd9bb78): created successfully Apr 28 19:21:05 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-bbe113e0-d5b2-4482-bc5f-44d9f84a7b70 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (653b668a-b570-4a61-864d-e5c895acf973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:05 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-bbe113e0-d5b2-4482-bc5f-44d9f84a7b70 tempest-VolumesGetTest-711720961 None] Flow 'volume_create_manager' (28af338b-5a91-4ca0-a1fe-00245b61158d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:21:05 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f6c9c0-5543-47bb-bbcb-c08221fdbe76]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:21:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2c330c24-6eb7-45e2-8cf8-c353bca188d8 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b2905753-39b2-4f3d-a483-0f4d803fa636 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:05 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-bbe113e0-d5b2-4482-bc5f-44d9f84a7b70 tempest-VolumesGetTest-711720961 None] Created volume successfully. Apr 28 19:21:05 devstack sudo[90450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b2905753-39b2-4f3d-a483-0f4d803fa636 Apr 28 19:21:05 devstack sudo[90450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:05 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8006900a-c6cb-456c-b120-355516cd4e40 tempest-VolumesGetTest-711720961 None] Acquiring lock "cinder-9f8b390d-a826-44f8-8ef4-b9522bd9bb78-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:21:05 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8006900a-c6cb-456c-b120-355516cd4e40 tempest-VolumesGetTest-711720961 None] Lock "cinder-9f8b390d-a826-44f8-8ef4-b9522bd9bb78-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:21:05 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8006900a-c6cb-456c-b120-355516cd4e40 tempest-VolumesGetTest-711720961 None] Acquiring lock "cinder-quobyte-9f8b390d-a826-44f8-8ef4-b9522bd9bb78" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:21:05 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8006900a-c6cb-456c-b120-355516cd4e40 tempest-VolumesGetTest-711720961 None] Lock "cinder-quobyte-9f8b390d-a826-44f8-8ef4-b9522bd9bb78" acquired by "delete_volume" :: waited 0.019s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:21:05 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e180a760-40ec-438b-8ee6-5dfd89fc389e]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:21:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8006900a-c6cb-456c-b120-355516cd4e40 tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9f8b390d-a826-44f8-8ef4-b9522bd9bb78 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:05 devstack sudo[90452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9f8b390d-a826-44f8-8ef4-b9522bd9bb78 Apr 28 19:21:05 devstack sudo[90452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:06 devstack sudo[90450]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2c330c24-6eb7-45e2-8cf8-c353bca188d8 tempest-GroupSnapshotsTest-2116439637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b2905753-39b2-4f3d-a483-0f4d803fa636" returned: 0 in 0.854s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2c330c24-6eb7-45e2-8cf8-c353bca188d8 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b2905753-39b2-4f3d-a483-0f4d803fa636,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b2905753-39b2-4f3d-a483-0f4d803fa636.2a96df8b-c46d-470b-af3e-7f8dbb7d9ffa 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:06 devstack sudo[90458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b2905753-39b2-4f3d-a483-0f4d803fa636,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b2905753-39b2-4f3d-a483-0f4d803fa636.2a96df8b-c46d-470b-af3e-7f8dbb7d9ffa 1G Apr 28 19:21:06 devstack sudo[90458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:06 devstack sudo[90452]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8006900a-c6cb-456c-b120-355516cd4e40 tempest-VolumesGetTest-711720961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9f8b390d-a826-44f8-8ef4-b9522bd9bb78" returned: 0 in 0.796s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8006900a-c6cb-456c-b120-355516cd4e40 tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9f8b390d-a826-44f8-8ef4-b9522bd9bb78 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:06 devstack sudo[90463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9f8b390d-a826-44f8-8ef4-b9522bd9bb78 Apr 28 19:21:06 devstack sudo[90463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:07 devstack sudo[90458]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2c330c24-6eb7-45e2-8cf8-c353bca188d8 tempest-GroupSnapshotsTest-2116439637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b2905753-39b2-4f3d-a483-0f4d803fa636,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b2905753-39b2-4f3d-a483-0f4d803fa636.2a96df8b-c46d-470b-af3e-7f8dbb7d9ffa 1G" returned: 0 in 0.848s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2c330c24-6eb7-45e2-8cf8-c353bca188d8 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2905753-39b2-4f3d-a483-0f4d803fa636 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b2905753-39b2-4f3d-a483-0f4d803fa636.2a96df8b-c46d-470b-af3e-7f8dbb7d9ffa {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:07 devstack sudo[90469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2905753-39b2-4f3d-a483-0f4d803fa636 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b2905753-39b2-4f3d-a483-0f4d803fa636.2a96df8b-c46d-470b-af3e-7f8dbb7d9ffa Apr 28 19:21:07 devstack sudo[90469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:07 devstack sudo[90463]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8006900a-c6cb-456c-b120-355516cd4e40 tempest-VolumesGetTest-711720961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9f8b390d-a826-44f8-8ef4-b9522bd9bb78" returned: 0 in 0.685s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:07 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8006900a-c6cb-456c-b120-355516cd4e40 tempest-VolumesGetTest-711720961 None] Lock "cinder-quobyte-9f8b390d-a826-44f8-8ef4-b9522bd9bb78" released by "delete_volume" :: held 1.538s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:21:07 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-8006900a-c6cb-456c-b120-355516cd4e40 tempest-VolumesGetTest-711720961 None] Created reservations ['7124e06f-7f85-48f0-bcfa-810b371b39cb', 'b52cf4ea-5532-45f1-bb30-9f8a255efa6e', '5fbdec4d-7eba-4a2e-8fbd-41d62afeb6fa', 'bc42d778-913e-4c92-a5e4-c3d4188ff757'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:21:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8006900a-c6cb-456c-b120-355516cd4e40 tempest-VolumesGetTest-711720961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:21:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8006900a-c6cb-456c-b120-355516cd4e40 tempest-VolumesGetTest-711720961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:21:07 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-8006900a-c6cb-456c-b120-355516cd4e40 tempest-VolumesGetTest-711720961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:21:07 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-8006900a-c6cb-456c-b120-355516cd4e40 tempest-VolumesGetTest-711720961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:21:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8006900a-c6cb-456c-b120-355516cd4e40 tempest-VolumesGetTest-711720961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:21:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8006900a-c6cb-456c-b120-355516cd4e40 tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:07 devstack sudo[90472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:21:07 devstack sudo[90472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:07 devstack sudo[90469]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2c330c24-6eb7-45e2-8cf8-c353bca188d8 tempest-GroupSnapshotsTest-2116439637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2905753-39b2-4f3d-a483-0f4d803fa636 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b2905753-39b2-4f3d-a483-0f4d803fa636.2a96df8b-c46d-470b-af3e-7f8dbb7d9ffa" returned: 0 in 0.676s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:07 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-2c330c24-6eb7-45e2-8cf8-c353bca188d8 tempest-GroupSnapshotsTest-2116439637 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b2905753-39b2-4f3d-a483-0f4d803fa636.2a96df8b-c46d-470b-af3e-7f8dbb7d9ffa is being set with open permissions: ugo+rw: NotImplementedError Apr 28 19:21:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2c330c24-6eb7-45e2-8cf8-c353bca188d8 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b2905753-39b2-4f3d-a483-0f4d803fa636.2a96df8b-c46d-470b-af3e-7f8dbb7d9ffa {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:07 devstack sudo[90477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b2905753-39b2-4f3d-a483-0f4d803fa636.2a96df8b-c46d-470b-af3e-7f8dbb7d9ffa Apr 28 19:21:07 devstack sudo[90477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:08 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-061fee08-7c7d-4cec-989a-846f021c34c5 tempest-VolumesGetTest-711720961 None] Acquiring lock "cinder-085a4b75-1622-4c9f-93bc-1633f56499d4-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:21:08 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-061fee08-7c7d-4cec-989a-846f021c34c5 tempest-VolumesGetTest-711720961 None] Lock "cinder-085a4b75-1622-4c9f-93bc-1633f56499d4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:21:08 devstack sudo[90472]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8006900a-c6cb-456c-b120-355516cd4e40 tempest-VolumesGetTest-711720961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.660s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:08 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-8006900a-c6cb-456c-b120-355516cd4e40 tempest-VolumesGetTest-711720961 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:21:08 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-8006900a-c6cb-456c-b120-355516cd4e40 tempest-VolumesGetTest-711720961 None] Deleted volume successfully. Apr 28 19:21:08 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-061fee08-7c7d-4cec-989a-846f021c34c5 tempest-VolumesGetTest-711720961 None] Acquiring lock "cinder-quobyte-085a4b75-1622-4c9f-93bc-1633f56499d4" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:21:08 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8006900a-c6cb-456c-b120-355516cd4e40 tempest-VolumesGetTest-711720961 None] Lock "cinder-9f8b390d-a826-44f8-8ef4-b9522bd9bb78-delete_volume" released by "delete_volume" :: held 2.432s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:21:08 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-061fee08-7c7d-4cec-989a-846f021c34c5 tempest-VolumesGetTest-711720961 None] Lock "cinder-quobyte-085a4b75-1622-4c9f-93bc-1633f56499d4" acquired by "delete_volume" :: waited 0.021s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:21:08 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcafc571-3f26-490e-977c-418f2ac385e1]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:21:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-061fee08-7c7d-4cec-989a-846f021c34c5 tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-085a4b75-1622-4c9f-93bc-1633f56499d4 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:08 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-466bc330-fe8a-4153-921c-a6c09fd172d3 tempest-VolumesDeleteCascade-1370866783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:21:08 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-466bc330-fe8a-4153-921c-a6c09fd172d3 tempest-VolumesDeleteCascade-1370866783 None] Flow 'volume_create_manager' (13aba531-cc71-42a0-8995-69325fa1b72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:21:08 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-466bc330-fe8a-4153-921c-a6c09fd172d3 tempest-VolumesDeleteCascade-1370866783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c9a5a14-f100-4ac4-ae67-aac3808db824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:08 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-466bc330-fe8a-4153-921c-a6c09fd172d3 tempest-VolumesDeleteCascade-1370866783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c9a5a14-f100-4ac4-ae67-aac3808db824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1400649519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b433099-f391-418c-92e9-35fff14bead7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c74bec58de48a0a09954d83a282ce7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:21:08Z,use_quota=True,user_id='fb5ff5edc6b244418fca76edd1bb9826',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:08 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-466bc330-fe8a-4153-921c-a6c09fd172d3 tempest-VolumesDeleteCascade-1370866783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68e57cd0-4444-454c-ba19-ecd8d4c785a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:08 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-466bc330-fe8a-4153-921c-a6c09fd172d3 tempest-VolumesDeleteCascade-1370866783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68e57cd0-4444-454c-ba19-ecd8d4c785a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:08 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-466bc330-fe8a-4153-921c-a6c09fd172d3 tempest-VolumesDeleteCascade-1370866783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (567d86d8-a979-490e-a955-8baf0da11105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:08 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-466bc330-fe8a-4153-921c-a6c09fd172d3 tempest-VolumesDeleteCascade-1370866783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (567d86d8-a979-490e-a955-8baf0da11105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b433099-f391-418c-92e9-35fff14bead7', 'volume_name': 'volume-3b433099-f391-418c-92e9-35fff14bead7', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:08 devstack sudo[90480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-085a4b75-1622-4c9f-93bc-1633f56499d4 Apr 28 19:21:08 devstack sudo[90480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:08 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-466bc330-fe8a-4153-921c-a6c09fd172d3 tempest-VolumesDeleteCascade-1370866783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e6e7eb0-f1a6-426f-ab33-7f099fccd098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:08 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-466bc330-fe8a-4153-921c-a6c09fd172d3 tempest-VolumesDeleteCascade-1370866783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e6e7eb0-f1a6-426f-ab33-7f099fccd098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:08 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-466bc330-fe8a-4153-921c-a6c09fd172d3 tempest-VolumesDeleteCascade-1370866783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c3f3f77-92b0-4bbc-b8fd-0ff5d3ddda51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:08 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-466bc330-fe8a-4153-921c-a6c09fd172d3 tempest-VolumesDeleteCascade-1370866783 None] Volume 3b433099-f391-418c-92e9-35fff14bead7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b433099-f391-418c-92e9-35fff14bead7', 'volume_size': 1} Apr 28 19:21:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-466bc330-fe8a-4153-921c-a6c09fd172d3 tempest-VolumesDeleteCascade-1370866783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:21:08 devstack sudo[90477]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2c330c24-6eb7-45e2-8cf8-c353bca188d8 tempest-GroupSnapshotsTest-2116439637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b2905753-39b2-4f3d-a483-0f4d803fa636.2a96df8b-c46d-470b-af3e-7f8dbb7d9ffa" returned: 0 in 0.726s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2c330c24-6eb7-45e2-8cf8-c353bca188d8 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b2905753-39b2-4f3d-a483-0f4d803fa636.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:08 devstack sudo[90483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b2905753-39b2-4f3d-a483-0f4d803fa636.info Apr 28 19:21:08 devstack sudo[90483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:08 devstack sudo[90480]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-061fee08-7c7d-4cec-989a-846f021c34c5 tempest-VolumesGetTest-711720961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-085a4b75-1622-4c9f-93bc-1633f56499d4" returned: 0 in 0.751s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-061fee08-7c7d-4cec-989a-846f021c34c5 tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-085a4b75-1622-4c9f-93bc-1633f56499d4 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:09 devstack sudo[90488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-085a4b75-1622-4c9f-93bc-1633f56499d4 Apr 28 19:21:09 devstack sudo[90488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:09 devstack sudo[90483]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2c330c24-6eb7-45e2-8cf8-c353bca188d8 tempest-GroupSnapshotsTest-2116439637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b2905753-39b2-4f3d-a483-0f4d803fa636.info" returned: 0 in 0.640s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:09 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-2c330c24-6eb7-45e2-8cf8-c353bca188d8 tempest-GroupSnapshotsTest-2116439637 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b2905753-39b2-4f3d-a483-0f4d803fa636.info is being set with open permissions: ugo+rw: NotImplementedError Apr 28 19:21:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2c330c24-6eb7-45e2-8cf8-c353bca188d8 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b2905753-39b2-4f3d-a483-0f4d803fa636.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:09 devstack sudo[90491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b2905753-39b2-4f3d-a483-0f4d803fa636.info Apr 28 19:21:09 devstack sudo[90491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:09 devstack sudo[90488]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-061fee08-7c7d-4cec-989a-846f021c34c5 tempest-VolumesGetTest-711720961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-085a4b75-1622-4c9f-93bc-1633f56499d4" returned: 0 in 0.609s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:09 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-061fee08-7c7d-4cec-989a-846f021c34c5 tempest-VolumesGetTest-711720961 None] Lock "cinder-quobyte-085a4b75-1622-4c9f-93bc-1633f56499d4" released by "delete_volume" :: held 1.418s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:21:09 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-061fee08-7c7d-4cec-989a-846f021c34c5 tempest-VolumesGetTest-711720961 None] Created reservations ['e6f7dd64-e8ce-4f8b-a8a9-1c19df9f8e00', '1a2cb5b0-149a-415c-a7c7-25ffffc305c7', '53604b92-7277-4dcf-aa0a-d221cb04447b', '3eb5dbc5-f400-42fe-a1de-b36ba11074f4'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:21:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-061fee08-7c7d-4cec-989a-846f021c34c5 tempest-VolumesGetTest-711720961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:21:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-061fee08-7c7d-4cec-989a-846f021c34c5 tempest-VolumesGetTest-711720961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:21:09 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-061fee08-7c7d-4cec-989a-846f021c34c5 tempest-VolumesGetTest-711720961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:21:09 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-061fee08-7c7d-4cec-989a-846f021c34c5 tempest-VolumesGetTest-711720961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:21:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-061fee08-7c7d-4cec-989a-846f021c34c5 tempest-VolumesGetTest-711720961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:21:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-061fee08-7c7d-4cec-989a-846f021c34c5 tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:09 devstack sudo[90491]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2c330c24-6eb7-45e2-8cf8-c353bca188d8 tempest-GroupSnapshotsTest-2116439637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b2905753-39b2-4f3d-a483-0f4d803fa636.info" returned: 0 in 0.621s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:09 devstack sudo[90495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:21:09 devstack sudo[90495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2c330c24-6eb7-45e2-8cf8-c353bca188d8 tempest-GroupSnapshotsTest-2116439637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.473s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:21:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2c330c24-6eb7-45e2-8cf8-c353bca188d8 tempest-GroupSnapshotsTest-2116439637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:21:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2c330c24-6eb7-45e2-8cf8-c353bca188d8 tempest-GroupSnapshotsTest-2116439637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:21:09 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-2c330c24-6eb7-45e2-8cf8-c353bca188d8 tempest-GroupSnapshotsTest-2116439637 None] Creating offline snapshot 366731d3-cb08-4a06-a0e5-8a77b87fe1ec of volume 1ed61aed-b4c8-4374-bcc7-058abea6ab3e {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 19:21:09 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea6699b-9ac4-47fa-9625-0f88ace97c17]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:21:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2c330c24-6eb7-45e2-8cf8-c353bca188d8 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:09 devstack sudo[90497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e Apr 28 19:21:09 devstack sudo[90497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:10 devstack sudo[90495]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-061fee08-7c7d-4cec-989a-846f021c34c5 tempest-VolumesGetTest-711720961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.613s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:10 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-061fee08-7c7d-4cec-989a-846f021c34c5 tempest-VolumesGetTest-711720961 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:21:10 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-061fee08-7c7d-4cec-989a-846f021c34c5 tempest-VolumesGetTest-711720961 None] Deleted volume successfully. Apr 28 19:21:10 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-061fee08-7c7d-4cec-989a-846f021c34c5 tempest-VolumesGetTest-711720961 None] Lock "cinder-085a4b75-1622-4c9f-93bc-1633f56499d4-delete_volume" released by "delete_volume" :: held 2.297s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:21:10 devstack sudo[90497]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2c330c24-6eb7-45e2-8cf8-c353bca188d8 tempest-GroupSnapshotsTest-2116439637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e" returned: 0 in 0.788s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2c330c24-6eb7-45e2-8cf8-c353bca188d8 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e.366731d3-cb08-4a06-a0e5-8a77b87fe1ec 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:10 devstack sudo[90503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e.366731d3-cb08-4a06-a0e5-8a77b87fe1ec 1G Apr 28 19:21:10 devstack sudo[90503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:10 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-aea367a0-5d2e-467a-8f5b-e3c0580f0b54 tempest-VolumesGetTest-711720961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:21:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-aea367a0-5d2e-467a-8f5b-e3c0580f0b54 tempest-VolumesGetTest-711720961 None] Flow 'volume_create_manager' (83b1d8ce-e245-4f22-8c2d-67bdc9a18723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:21:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-aea367a0-5d2e-467a-8f5b-e3c0580f0b54 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7211f87-df54-4bd6-bde2-904bd650ba5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-aea367a0-5d2e-467a-8f5b-e3c0580f0b54 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7211f87-df54-4bd6-bde2-904bd650ba5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-210298132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01a2bf25-4ee1-4407-8151-a98f3d0a27e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8969a99ceb4c87b83e42ed49dfe036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:21:11Z,use_quota=True,user_id='49def545e71141ef8b767db7c433c4f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-aea367a0-5d2e-467a-8f5b-e3c0580f0b54 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4304acc-77f2-4a99-a55d-7d9cb0332b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-aea367a0-5d2e-467a-8f5b-e3c0580f0b54 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4304acc-77f2-4a99-a55d-7d9cb0332b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-aea367a0-5d2e-467a-8f5b-e3c0580f0b54 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0e76bef-7793-4955-824b-446440110e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-aea367a0-5d2e-467a-8f5b-e3c0580f0b54 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0e76bef-7793-4955-824b-446440110e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01a2bf25-4ee1-4407-8151-a98f3d0a27e6', 'volume_name': 'volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-aea367a0-5d2e-467a-8f5b-e3c0580f0b54 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b046b19-9eb2-4eab-b7dd-3fb3725dad69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-aea367a0-5d2e-467a-8f5b-e3c0580f0b54 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b046b19-9eb2-4eab-b7dd-3fb3725dad69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-aea367a0-5d2e-467a-8f5b-e3c0580f0b54 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6634417-7982-4e1b-b511-1c041c9645fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:10 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-aea367a0-5d2e-467a-8f5b-e3c0580f0b54 tempest-VolumesGetTest-711720961 None] Volume 01a2bf25-4ee1-4407-8151-a98f3d0a27e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6', 'volume_size': 1} Apr 28 19:21:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-aea367a0-5d2e-467a-8f5b-e3c0580f0b54 tempest-VolumesGetTest-711720961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:21:11 devstack sudo[90503]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2c330c24-6eb7-45e2-8cf8-c353bca188d8 tempest-GroupSnapshotsTest-2116439637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e.366731d3-cb08-4a06-a0e5-8a77b87fe1ec 1G" returned: 0 in 0.717s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2c330c24-6eb7-45e2-8cf8-c353bca188d8 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e.366731d3-cb08-4a06-a0e5-8a77b87fe1ec {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:11 devstack sudo[90509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e.366731d3-cb08-4a06-a0e5-8a77b87fe1ec Apr 28 19:21:11 devstack sudo[90509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:11 devstack sudo[90509]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2c330c24-6eb7-45e2-8cf8-c353bca188d8 tempest-GroupSnapshotsTest-2116439637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e.366731d3-cb08-4a06-a0e5-8a77b87fe1ec" returned: 0 in 0.633s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:11 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-2c330c24-6eb7-45e2-8cf8-c353bca188d8 tempest-GroupSnapshotsTest-2116439637 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e.366731d3-cb08-4a06-a0e5-8a77b87fe1ec is being set with open permissions: ugo+rw: NotImplementedError Apr 28 19:21:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2c330c24-6eb7-45e2-8cf8-c353bca188d8 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e.366731d3-cb08-4a06-a0e5-8a77b87fe1ec {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:11 devstack sudo[90514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e.366731d3-cb08-4a06-a0e5-8a77b87fe1ec Apr 28 19:21:11 devstack sudo[90514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:12 devstack sudo[90514]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2c330c24-6eb7-45e2-8cf8-c353bca188d8 tempest-GroupSnapshotsTest-2116439637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e.366731d3-cb08-4a06-a0e5-8a77b87fe1ec" returned: 0 in 0.579s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2c330c24-6eb7-45e2-8cf8-c353bca188d8 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:12 devstack sudo[90517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e.info Apr 28 19:21:12 devstack sudo[90517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:13 devstack sudo[90517]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2c330c24-6eb7-45e2-8cf8-c353bca188d8 tempest-GroupSnapshotsTest-2116439637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e.info" returned: 0 in 0.588s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:13 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-2c330c24-6eb7-45e2-8cf8-c353bca188d8 tempest-GroupSnapshotsTest-2116439637 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e.info is being set with open permissions: ugo+rw: NotImplementedError Apr 28 19:21:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2c330c24-6eb7-45e2-8cf8-c353bca188d8 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:13 devstack sudo[90520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e.info Apr 28 19:21:13 devstack sudo[90520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:13 devstack sudo[90520]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2c330c24-6eb7-45e2-8cf8-c353bca188d8 tempest-GroupSnapshotsTest-2116439637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e.info" returned: 0 in 0.605s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2c330c24-6eb7-45e2-8cf8-c353bca188d8 tempest-GroupSnapshotsTest-2116439637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.990s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:21:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-466bc330-fe8a-4153-921c-a6c09fd172d3 tempest-VolumesDeleteCascade-1370866783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.393s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:21:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-466bc330-fe8a-4153-921c-a6c09fd172d3 tempest-VolumesDeleteCascade-1370866783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1400649519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b433099-f391-418c-92e9-35fff14bead7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c74bec58de48a0a09954d83a282ce7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:21:08Z,use_quota=True,user_id='fb5ff5edc6b244418fca76edd1bb9826',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:21:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-466bc330-fe8a-4153-921c-a6c09fd172d3 tempest-VolumesDeleteCascade-1370866783 None] Creating volume 3b433099-f391-418c-92e9-35fff14bead7 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:21:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-466bc330-fe8a-4153-921c-a6c09fd172d3 tempest-VolumesDeleteCascade-1370866783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:21:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-466bc330-fe8a-4153-921c-a6c09fd172d3 tempest-VolumesDeleteCascade-1370866783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:21:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-466bc330-fe8a-4153-921c-a6c09fd172d3 tempest-VolumesDeleteCascade-1370866783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:21:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-466bc330-fe8a-4153-921c-a6c09fd172d3 tempest-VolumesDeleteCascade-1370866783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:21:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-466bc330-fe8a-4153-921c-a6c09fd172d3 tempest-VolumesDeleteCascade-1370866783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:21:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-466bc330-fe8a-4153-921c-a6c09fd172d3 tempest-VolumesDeleteCascade-1370866783 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:21:13 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-466bc330-fe8a-4153-921c-a6c09fd172d3 tempest-VolumesDeleteCascade-1370866783 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:21:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-466bc330-fe8a-4153-921c-a6c09fd172d3 tempest-VolumesDeleteCascade-1370866783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:13 devstack sudo[90523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7 1073741824 Apr 28 19:21:13 devstack sudo[90523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:13 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-2c330c24-6eb7-45e2-8cf8-c353bca188d8 tempest-GroupSnapshotsTest-2116439637 None] group_snapshot edd641dc-b9df-45c2-af11-a01694afe835: created successfully Apr 28 19:21:14 devstack sudo[90523]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-466bc330-fe8a-4153-921c-a6c09fd172d3 tempest-VolumesDeleteCascade-1370866783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7 1073741824" returned: 0 in 0.771s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-466bc330-fe8a-4153-921c-a6c09fd172d3 tempest-VolumesDeleteCascade-1370866783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:14 devstack sudo[90528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7 Apr 28 19:21:14 devstack sudo[90528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:14 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-aef4f3cb-def8-4dad-9e06-7301f6a8a537 tempest-GroupSnapshotsTest-2116439637 None] group_snapshot edd641dc-b9df-45c2-af11-a01694afe835: deleting Apr 28 19:21:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-aef4f3cb-def8-4dad-9e06-7301f6a8a537 tempest-GroupSnapshotsTest-2116439637 None] group_snapshot edd641dc-b9df-45c2-af11-a01694afe835: deleting {{(pid=83863) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 28 19:21:14 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-aef4f3cb-def8-4dad-9e06-7301f6a8a537 tempest-GroupSnapshotsTest-2116439637 None] Acquiring lock "cinder-quobyte-b2905753-39b2-4f3d-a483-0f4d803fa636" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:21:14 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-aef4f3cb-def8-4dad-9e06-7301f6a8a537 tempest-GroupSnapshotsTest-2116439637 None] Lock "cinder-quobyte-b2905753-39b2-4f3d-a483-0f4d803fa636" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:21:14 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-aef4f3cb-def8-4dad-9e06-7301f6a8a537 tempest-GroupSnapshotsTest-2116439637 None] Acquiring lock "cinder-quobyte-2a96df8b-c46d-470b-af3e-7f8dbb7d9ffa" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:21:14 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-aef4f3cb-def8-4dad-9e06-7301f6a8a537 tempest-GroupSnapshotsTest-2116439637 None] Lock "cinder-quobyte-2a96df8b-c46d-470b-af3e-7f8dbb7d9ffa" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:21:14 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-aef4f3cb-def8-4dad-9e06-7301f6a8a537 tempest-GroupSnapshotsTest-2116439637 None] Deleting offline snapshot 2a96df8b-c46d-470b-af3e-7f8dbb7d9ffa of volume b2905753-39b2-4f3d-a483-0f4d803fa636 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 19:21:14 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-aef4f3cb-def8-4dad-9e06-7301f6a8a537 tempest-GroupSnapshotsTest-2116439637 None] snapshot_file for this snap is: volume-b2905753-39b2-4f3d-a483-0f4d803fa636.2a96df8b-c46d-470b-af3e-7f8dbb7d9ffa {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 19:21:14 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d13416-25be-4f2a-96ad-5b855f566d20]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:21:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aef4f3cb-def8-4dad-9e06-7301f6a8a537 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b2905753-39b2-4f3d-a483-0f4d803fa636.2a96df8b-c46d-470b-af3e-7f8dbb7d9ffa {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:15 devstack sudo[90530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b2905753-39b2-4f3d-a483-0f4d803fa636.2a96df8b-c46d-470b-af3e-7f8dbb7d9ffa Apr 28 19:21:15 devstack sudo[90530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:15 devstack sudo[90528]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-466bc330-fe8a-4153-921c-a6c09fd172d3 tempest-VolumesDeleteCascade-1370866783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7" returned: 0 in 0.649s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:15 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-466bc330-fe8a-4153-921c-a6c09fd172d3 tempest-VolumesDeleteCascade-1370866783 None] <== create_volume: return (1461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:21:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-466bc330-fe8a-4153-921c-a6c09fd172d3 tempest-VolumesDeleteCascade-1370866783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:21:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-aea367a0-5d2e-467a-8f5b-e3c0580f0b54 tempest-VolumesGetTest-711720961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.508s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:21:15 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-aea367a0-5d2e-467a-8f5b-e3c0580f0b54 tempest-VolumesGetTest-711720961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-210298132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01a2bf25-4ee1-4407-8151-a98f3d0a27e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8969a99ceb4c87b83e42ed49dfe036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:21:11Z,use_quota=True,user_id='49def545e71141ef8b767db7c433c4f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:21:15 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-aea367a0-5d2e-467a-8f5b-e3c0580f0b54 tempest-VolumesGetTest-711720961 None] Creating volume 01a2bf25-4ee1-4407-8151-a98f3d0a27e6 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:21:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-aea367a0-5d2e-467a-8f5b-e3c0580f0b54 tempest-VolumesGetTest-711720961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:21:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-aea367a0-5d2e-467a-8f5b-e3c0580f0b54 tempest-VolumesGetTest-711720961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:21:15 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-aea367a0-5d2e-467a-8f5b-e3c0580f0b54 tempest-VolumesGetTest-711720961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:21:15 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-aea367a0-5d2e-467a-8f5b-e3c0580f0b54 tempest-VolumesGetTest-711720961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:21:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-aea367a0-5d2e-467a-8f5b-e3c0580f0b54 tempest-VolumesGetTest-711720961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:21:15 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-aea367a0-5d2e-467a-8f5b-e3c0580f0b54 tempest-VolumesGetTest-711720961 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:21:15 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-aea367a0-5d2e-467a-8f5b-e3c0580f0b54 tempest-VolumesGetTest-711720961 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:21:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aea367a0-5d2e-467a-8f5b-e3c0580f0b54 tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:15 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-466bc330-fe8a-4153-921c-a6c09fd172d3 tempest-VolumesDeleteCascade-1370866783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c3f3f77-92b0-4bbc-b8fd-0ff5d3ddda51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b433099-f391-418c-92e9-35fff14bead7', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:15 devstack sudo[90533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6 1073741824 Apr 28 19:21:15 devstack sudo[90533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:15 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-466bc330-fe8a-4153-921c-a6c09fd172d3 tempest-VolumesDeleteCascade-1370866783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bb64354-2a22-4532-8126-e749299a8e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:15 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-466bc330-fe8a-4153-921c-a6c09fd172d3 tempest-VolumesDeleteCascade-1370866783 None] Volume volume-3b433099-f391-418c-92e9-35fff14bead7 (3b433099-f391-418c-92e9-35fff14bead7): created successfully Apr 28 19:21:15 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-466bc330-fe8a-4153-921c-a6c09fd172d3 tempest-VolumesDeleteCascade-1370866783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bb64354-2a22-4532-8126-e749299a8e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:15 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-466bc330-fe8a-4153-921c-a6c09fd172d3 tempest-VolumesDeleteCascade-1370866783 None] Flow 'volume_create_manager' (13aba531-cc71-42a0-8995-69325fa1b72c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:21:15 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-466bc330-fe8a-4153-921c-a6c09fd172d3 tempest-VolumesDeleteCascade-1370866783 None] Created volume successfully. Apr 28 19:21:15 devstack sudo[90530]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aef4f3cb-def8-4dad-9e06-7301f6a8a537 tempest-GroupSnapshotsTest-2116439637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b2905753-39b2-4f3d-a483-0f4d803fa636.2a96df8b-c46d-470b-af3e-7f8dbb7d9ffa" returned: 0 in 0.768s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:15 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-aef4f3cb-def8-4dad-9e06-7301f6a8a537 tempest-GroupSnapshotsTest-2116439637 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2905753-39b2-4f3d-a483-0f4d803fa636(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:21:15 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca3a22f-29a3-4e59-807b-204ba93ab3e4]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:21:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aef4f3cb-def8-4dad-9e06-7301f6a8a537 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b2905753-39b2-4f3d-a483-0f4d803fa636 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9cfda6bb-66d0-4424-a8d3-88fd3b97ee60 tempest-VolumesDeleteCascade-1370866783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:21:15 devstack sudo[90538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b2905753-39b2-4f3d-a483-0f4d803fa636 Apr 28 19:21:15 devstack sudo[90538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:16 devstack sudo[90533]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aea367a0-5d2e-467a-8f5b-e3c0580f0b54 tempest-VolumesGetTest-711720961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6 1073741824" returned: 0 in 0.855s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aea367a0-5d2e-467a-8f5b-e3c0580f0b54 tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:16 devstack sudo[90544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6 Apr 28 19:21:16 devstack sudo[90544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:16 devstack sudo[90538]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aef4f3cb-def8-4dad-9e06-7301f6a8a537 tempest-GroupSnapshotsTest-2116439637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b2905753-39b2-4f3d-a483-0f4d803fa636" returned: 0 in 0.817s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aef4f3cb-def8-4dad-9e06-7301f6a8a537 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b2905753-39b2-4f3d-a483-0f4d803fa636.2a96df8b-c46d-470b-af3e-7f8dbb7d9ffa {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:16 devstack sudo[90549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b2905753-39b2-4f3d-a483-0f4d803fa636.2a96df8b-c46d-470b-af3e-7f8dbb7d9ffa Apr 28 19:21:16 devstack sudo[90549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:16 devstack sudo[90544]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aea367a0-5d2e-467a-8f5b-e3c0580f0b54 tempest-VolumesGetTest-711720961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6" returned: 0 in 0.617s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:16 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-aea367a0-5d2e-467a-8f5b-e3c0580f0b54 tempest-VolumesGetTest-711720961 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:21:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-aea367a0-5d2e-467a-8f5b-e3c0580f0b54 tempest-VolumesGetTest-711720961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.520s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:21:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9cfda6bb-66d0-4424-a8d3-88fd3b97ee60 tempest-VolumesDeleteCascade-1370866783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.879s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:21:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-aea367a0-5d2e-467a-8f5b-e3c0580f0b54 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6634417-7982-4e1b-b511-1c041c9645fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-aea367a0-5d2e-467a-8f5b-e3c0580f0b54 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4b5d4f6-a806-40d4-8430-7ad240dd8957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:16 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-9cfda6bb-66d0-4424-a8d3-88fd3b97ee60 tempest-VolumesDeleteCascade-1370866783 None] Creating offline snapshot 503a0b1b-12bb-4478-81c7-cd193875b72f of volume 3b433099-f391-418c-92e9-35fff14bead7 {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 19:21:16 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[521995d7-321a-4c60-a496-34a18f9af5a7]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:21:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9cfda6bb-66d0-4424-a8d3-88fd3b97ee60 tempest-VolumesDeleteCascade-1370866783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:16 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-aea367a0-5d2e-467a-8f5b-e3c0580f0b54 tempest-VolumesGetTest-711720961 None] Volume volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6 (01a2bf25-4ee1-4407-8151-a98f3d0a27e6): created successfully Apr 28 19:21:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-aea367a0-5d2e-467a-8f5b-e3c0580f0b54 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4b5d4f6-a806-40d4-8430-7ad240dd8957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-aea367a0-5d2e-467a-8f5b-e3c0580f0b54 tempest-VolumesGetTest-711720961 None] Flow 'volume_create_manager' (83b1d8ce-e245-4f22-8c2d-67bdc9a18723) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:21:16 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-aea367a0-5d2e-467a-8f5b-e3c0580f0b54 tempest-VolumesGetTest-711720961 None] Created volume successfully. Apr 28 19:21:16 devstack sudo[90552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7 Apr 28 19:21:16 devstack sudo[90552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:17 devstack sudo[90549]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aef4f3cb-def8-4dad-9e06-7301f6a8a537 tempest-GroupSnapshotsTest-2116439637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b2905753-39b2-4f3d-a483-0f4d803fa636.2a96df8b-c46d-470b-af3e-7f8dbb7d9ffa" returned: 0 in 0.759s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aef4f3cb-def8-4dad-9e06-7301f6a8a537 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b2905753-39b2-4f3d-a483-0f4d803fa636.2a96df8b-c46d-470b-af3e-7f8dbb7d9ffa {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:17 devstack sudo[90557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b2905753-39b2-4f3d-a483-0f4d803fa636.2a96df8b-c46d-470b-af3e-7f8dbb7d9ffa Apr 28 19:21:17 devstack sudo[90557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:17 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:21:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Flow 'volume_create_manager' (d51b5980-0e48-477a-a48c-89dd5ef81c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:21:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7b8205e-9fb3-4d03-a903-e9dc73bba597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7b8205e-9fb3-4d03-a903-e9dc73bba597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1918355756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86523126-1505-449c-b266-78be2d33609f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9b8969a99ceb4c87b83e42ed49dfe036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=01a2bf25-4ee1-4407-8151-a98f3d0a27e6,status='creating',terminated_at=None,updated_at=2026-04-28T17:21:17Z,use_quota=True,user_id='49def545e71141ef8b767db7c433c4f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7be07097-9074-47e7-9429-85ab2cfeaa05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7be07097-9074-47e7-9429-85ab2cfeaa05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (773ada50-eb3d-42b1-8bd8-c0c839124cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (773ada50-eb3d-42b1-8bd8-c0c839124cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '86523126-1505-449c-b266-78be2d33609f', 'volume_name': 'volume-86523126-1505-449c-b266-78be2d33609f', 'volume_size': 1, 'source_volid': '01a2bf25-4ee1-4407-8151-a98f3d0a27e6', 'source_volstatus': 'available'}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e42050f-39e9-493d-a0e0-037d830842b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e42050f-39e9-493d-a0e0-037d830842b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6acde0f-76d8-486f-90f5-cc3a5c0905ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:17 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Volume 86523126-1505-449c-b266-78be2d33609f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-86523126-1505-449c-b266-78be2d33609f', 'volume_size': 1, 'source_volid': '01a2bf25-4ee1-4407-8151-a98f3d0a27e6', 'source_volstatus': 'available'} Apr 28 19:21:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:21:17 devstack sudo[90552]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9cfda6bb-66d0-4424-a8d3-88fd3b97ee60 tempest-VolumesDeleteCascade-1370866783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7" returned: 0 in 0.845s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9cfda6bb-66d0-4424-a8d3-88fd3b97ee60 tempest-VolumesDeleteCascade-1370866783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.503a0b1b-12bb-4478-81c7-cd193875b72f 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:17 devstack sudo[90562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.503a0b1b-12bb-4478-81c7-cd193875b72f 1G Apr 28 19:21:17 devstack sudo[90562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:17 devstack sudo[90557]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aef4f3cb-def8-4dad-9e06-7301f6a8a537 tempest-GroupSnapshotsTest-2116439637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b2905753-39b2-4f3d-a483-0f4d803fa636.2a96df8b-c46d-470b-af3e-7f8dbb7d9ffa" returned: 0 in 0.669s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:18 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-aef4f3cb-def8-4dad-9e06-7301f6a8a537 tempest-GroupSnapshotsTest-2116439637 None] Lock "cinder-quobyte-2a96df8b-c46d-470b-af3e-7f8dbb7d9ffa" released by "_delete_snapshot" :: held 3.125s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:21:18 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-aef4f3cb-def8-4dad-9e06-7301f6a8a537 tempest-GroupSnapshotsTest-2116439637 None] Lock "cinder-quobyte-b2905753-39b2-4f3d-a483-0f4d803fa636" released by "delete_snapshot" :: held 3.148s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:21:18 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-aef4f3cb-def8-4dad-9e06-7301f6a8a537 tempest-GroupSnapshotsTest-2116439637 None] Acquiring lock "cinder-quobyte-1ed61aed-b4c8-4374-bcc7-058abea6ab3e" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:21:18 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-aef4f3cb-def8-4dad-9e06-7301f6a8a537 tempest-GroupSnapshotsTest-2116439637 None] Lock "cinder-quobyte-1ed61aed-b4c8-4374-bcc7-058abea6ab3e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:21:18 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-aef4f3cb-def8-4dad-9e06-7301f6a8a537 tempest-GroupSnapshotsTest-2116439637 None] Acquiring lock "cinder-quobyte-366731d3-cb08-4a06-a0e5-8a77b87fe1ec" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:21:18 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-aef4f3cb-def8-4dad-9e06-7301f6a8a537 tempest-GroupSnapshotsTest-2116439637 None] Lock "cinder-quobyte-366731d3-cb08-4a06-a0e5-8a77b87fe1ec" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:21:18 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-aef4f3cb-def8-4dad-9e06-7301f6a8a537 tempest-GroupSnapshotsTest-2116439637 None] Deleting offline snapshot 366731d3-cb08-4a06-a0e5-8a77b87fe1ec of volume 1ed61aed-b4c8-4374-bcc7-058abea6ab3e {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 19:21:18 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-aef4f3cb-def8-4dad-9e06-7301f6a8a537 tempest-GroupSnapshotsTest-2116439637 None] snapshot_file for this snap is: volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e.366731d3-cb08-4a06-a0e5-8a77b87fe1ec {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 19:21:18 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[446f25d8-3fb4-48bc-a41e-1d305cb5c494]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:21:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aef4f3cb-def8-4dad-9e06-7301f6a8a537 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e.366731d3-cb08-4a06-a0e5-8a77b87fe1ec {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:18 devstack sudo[90565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e.366731d3-cb08-4a06-a0e5-8a77b87fe1ec Apr 28 19:21:18 devstack sudo[90565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:18 devstack sudo[90562]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9cfda6bb-66d0-4424-a8d3-88fd3b97ee60 tempest-VolumesDeleteCascade-1370866783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.503a0b1b-12bb-4478-81c7-cd193875b72f 1G" returned: 0 in 0.777s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9cfda6bb-66d0-4424-a8d3-88fd3b97ee60 tempest-VolumesDeleteCascade-1370866783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b433099-f391-418c-92e9-35fff14bead7 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.503a0b1b-12bb-4478-81c7-cd193875b72f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:18 devstack sudo[90570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b433099-f391-418c-92e9-35fff14bead7 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.503a0b1b-12bb-4478-81c7-cd193875b72f Apr 28 19:21:18 devstack sudo[90570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:18 devstack sudo[90565]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aef4f3cb-def8-4dad-9e06-7301f6a8a537 tempest-GroupSnapshotsTest-2116439637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e.366731d3-cb08-4a06-a0e5-8a77b87fe1ec" returned: 0 in 0.748s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:18 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-aef4f3cb-def8-4dad-9e06-7301f6a8a537 tempest-GroupSnapshotsTest-2116439637 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:21:18 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d4f616-5177-477f-9665-eed46e2c7891]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:21:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aef4f3cb-def8-4dad-9e06-7301f6a8a537 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:19 devstack sudo[90576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e Apr 28 19:21:19 devstack sudo[90576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:19 devstack sudo[90570]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9cfda6bb-66d0-4424-a8d3-88fd3b97ee60 tempest-VolumesDeleteCascade-1370866783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b433099-f391-418c-92e9-35fff14bead7 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.503a0b1b-12bb-4478-81c7-cd193875b72f" returned: 0 in 0.677s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:19 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-9cfda6bb-66d0-4424-a8d3-88fd3b97ee60 tempest-VolumesDeleteCascade-1370866783 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.503a0b1b-12bb-4478-81c7-cd193875b72f is being set with open permissions: ugo+rw Apr 28 19:21:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9cfda6bb-66d0-4424-a8d3-88fd3b97ee60 tempest-VolumesDeleteCascade-1370866783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.503a0b1b-12bb-4478-81c7-cd193875b72f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:19 devstack sudo[90581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.503a0b1b-12bb-4478-81c7-cd193875b72f Apr 28 19:21:19 devstack sudo[90581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:19 devstack sudo[90576]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aef4f3cb-def8-4dad-9e06-7301f6a8a537 tempest-GroupSnapshotsTest-2116439637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e" returned: 0 in 0.790s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aef4f3cb-def8-4dad-9e06-7301f6a8a537 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e.366731d3-cb08-4a06-a0e5-8a77b87fe1ec {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:19 devstack sudo[90587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e.366731d3-cb08-4a06-a0e5-8a77b87fe1ec Apr 28 19:21:19 devstack sudo[90587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:19 devstack sudo[90581]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9cfda6bb-66d0-4424-a8d3-88fd3b97ee60 tempest-VolumesDeleteCascade-1370866783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.503a0b1b-12bb-4478-81c7-cd193875b72f" returned: 0 in 0.613s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9cfda6bb-66d0-4424-a8d3-88fd3b97ee60 tempest-VolumesDeleteCascade-1370866783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:19 devstack sudo[90589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.info Apr 28 19:21:19 devstack sudo[90589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:20 devstack sudo[90589]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9cfda6bb-66d0-4424-a8d3-88fd3b97ee60 tempest-VolumesDeleteCascade-1370866783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.info" returned: 0 in 0.652s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:20 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-9cfda6bb-66d0-4424-a8d3-88fd3b97ee60 tempest-VolumesDeleteCascade-1370866783 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.info is being set with open permissions: ugo+rw Apr 28 19:21:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9cfda6bb-66d0-4424-a8d3-88fd3b97ee60 tempest-VolumesDeleteCascade-1370866783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:20 devstack sudo[90595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.info Apr 28 19:21:20 devstack sudo[90595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:20 devstack sudo[90587]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aef4f3cb-def8-4dad-9e06-7301f6a8a537 tempest-GroupSnapshotsTest-2116439637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e.366731d3-cb08-4a06-a0e5-8a77b87fe1ec" returned: 0 in 0.765s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aef4f3cb-def8-4dad-9e06-7301f6a8a537 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e.366731d3-cb08-4a06-a0e5-8a77b87fe1ec {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:20 devstack sudo[90597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e.366731d3-cb08-4a06-a0e5-8a77b87fe1ec Apr 28 19:21:20 devstack sudo[90597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:21 devstack sudo[90595]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9cfda6bb-66d0-4424-a8d3-88fd3b97ee60 tempest-VolumesDeleteCascade-1370866783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.info" returned: 0 in 0.614s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9cfda6bb-66d0-4424-a8d3-88fd3b97ee60 tempest-VolumesDeleteCascade-1370866783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.300s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:21:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.450s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:21:21 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Cloning volume 01a2bf25-4ee1-4407-8151-a98f3d0a27e6 to volume 86523126-1505-449c-b266-78be2d33609f Apr 28 19:21:21 devstack sudo[90597]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aef4f3cb-def8-4dad-9e06-7301f6a8a537 tempest-GroupSnapshotsTest-2116439637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e.366731d3-cb08-4a06-a0e5-8a77b87fe1ec" returned: 0 in 0.633s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:21 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-9cfda6bb-66d0-4424-a8d3-88fd3b97ee60 tempest-VolumesDeleteCascade-1370866783 None] Create snapshot completed successfully Apr 28 19:21:21 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Creating offline snapshot 90e3ac9a-bdef-483c-ac79-46a98214267b of volume 01a2bf25-4ee1-4407-8151-a98f3d0a27e6 {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 19:21:21 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-aef4f3cb-def8-4dad-9e06-7301f6a8a537 tempest-GroupSnapshotsTest-2116439637 None] Lock "cinder-quobyte-366731d3-cb08-4a06-a0e5-8a77b87fe1ec" released by "_delete_snapshot" :: held 3.056s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:21:21 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-aef4f3cb-def8-4dad-9e06-7301f6a8a537 tempest-GroupSnapshotsTest-2116439637 None] Lock "cinder-quobyte-1ed61aed-b4c8-4374-bcc7-058abea6ab3e" released by "delete_snapshot" :: held 3.080s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:21:21 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9732cb-f056-4788-a890-3454021df5a3]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:21:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:21 devstack cinder-volume[83863]: WARNING cinder.quota [None req-aef4f3cb-def8-4dad-9e06-7301f6a8a537 tempest-GroupSnapshotsTest-2116439637 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1208047567 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1208047567, it is now deprecated. Please use the default quota class for default quota. Apr 28 19:21:21 devstack cinder-volume[83863]: WARNING cinder.quota [None req-aef4f3cb-def8-4dad-9e06-7301f6a8a537 tempest-GroupSnapshotsTest-2116439637 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1208047567 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1208047567, it is now deprecated. Please use the default quota class for default quota. Apr 28 19:21:21 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-aef4f3cb-def8-4dad-9e06-7301f6a8a537 tempest-GroupSnapshotsTest-2116439637 None] Created reservations ['c01e75c0-5579-40b3-9c22-af065eba4ef1', '265ba840-1923-4e36-99ff-94605bda1124', '642c3ba7-4d65-4e21-ab08-aad9ebabba42', 'b6139abc-f76f-432a-ae5b-e984addb5fa3'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:21:21 devstack sudo[90602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6 Apr 28 19:21:21 devstack sudo[90602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:21 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-aef4f3cb-def8-4dad-9e06-7301f6a8a537 tempest-GroupSnapshotsTest-2116439637 None] Created reservations ['5a2ee86e-a6f7-446b-b21b-2cc19eba1ed5', '84448b95-590e-45d2-a953-5c5f5cbedcd0', '13895139-7a55-4d1d-91e9-a046067b1e15', '247d3a2a-2918-43e8-b639-94ca51886636'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:21:21 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-aef4f3cb-def8-4dad-9e06-7301f6a8a537 tempest-GroupSnapshotsTest-2116439637 None] group_snapshot edd641dc-b9df-45c2-af11-a01694afe835: deleted successfully Apr 28 19:21:21 devstack sudo[90602]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6" returned: 0 in 0.746s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6.90e3ac9a-bdef-483c-ac79-46a98214267b 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:21 devstack sudo[90607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6.90e3ac9a-bdef-483c-ac79-46a98214267b 1G Apr 28 19:21:21 devstack sudo[90607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-04c069dc-eb4a-4ba8-bd74-a9c986f204d0 tempest-VolumesDeleteCascade-1370866783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:21:22 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a577dbbe-2301-4567-a3c9-fca0742f6aa0 tempest-GroupSnapshotsTest-2116439637 None] Acquiring lock "cinder-quobyte-1ed61aed-b4c8-4374-bcc7-058abea6ab3e" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:21:22 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a577dbbe-2301-4567-a3c9-fca0742f6aa0 tempest-GroupSnapshotsTest-2116439637 None] Lock "cinder-quobyte-1ed61aed-b4c8-4374-bcc7-058abea6ab3e" acquired by "delete_volume" :: waited 0.015s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:21:22 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5989ea6-8a80-4217-aa06-b00199eb4757]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:21:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a577dbbe-2301-4567-a3c9-fca0742f6aa0 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:22 devstack sudo[90607]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6.90e3ac9a-bdef-483c-ac79-46a98214267b 1G" returned: 0 in 0.834s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6.90e3ac9a-bdef-483c-ac79-46a98214267b {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:22 devstack sudo[90613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6.90e3ac9a-bdef-483c-ac79-46a98214267b Apr 28 19:21:22 devstack sudo[90613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:22 devstack sudo[90612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e Apr 28 19:21:22 devstack sudo[90612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:23 devstack sudo[90612]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a577dbbe-2301-4567-a3c9-fca0742f6aa0 tempest-GroupSnapshotsTest-2116439637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e" returned: 0 in 0.730s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a577dbbe-2301-4567-a3c9-fca0742f6aa0 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:23 devstack sudo[90613]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6.90e3ac9a-bdef-483c-ac79-46a98214267b" returned: 0 in 0.682s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:23 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6.90e3ac9a-bdef-483c-ac79-46a98214267b is being set with open permissions: ugo+rw Apr 28 19:21:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6.90e3ac9a-bdef-483c-ac79-46a98214267b {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:23 devstack sudo[90623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e Apr 28 19:21:23 devstack sudo[90623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:23 devstack sudo[90624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6.90e3ac9a-bdef-483c-ac79-46a98214267b Apr 28 19:21:23 devstack sudo[90624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:24 devstack sudo[90623]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a577dbbe-2301-4567-a3c9-fca0742f6aa0 tempest-GroupSnapshotsTest-2116439637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-1ed61aed-b4c8-4374-bcc7-058abea6ab3e" returned: 0 in 0.626s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:24 devstack sudo[90624]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6.90e3ac9a-bdef-483c-ac79-46a98214267b" returned: 0 in 0.628s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:24 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a577dbbe-2301-4567-a3c9-fca0742f6aa0 tempest-GroupSnapshotsTest-2116439637 None] Lock "cinder-quobyte-1ed61aed-b4c8-4374-bcc7-058abea6ab3e" released by "delete_volume" :: held 1.436s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:21:24 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a577dbbe-2301-4567-a3c9-fca0742f6aa0 tempest-GroupSnapshotsTest-2116439637 None] Acquiring lock "cinder-quobyte-b2905753-39b2-4f3d-a483-0f4d803fa636" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:21:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:24 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a577dbbe-2301-4567-a3c9-fca0742f6aa0 tempest-GroupSnapshotsTest-2116439637 None] Lock "cinder-quobyte-b2905753-39b2-4f3d-a483-0f4d803fa636" acquired by "delete_volume" :: waited 0.037s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:21:24 devstack sudo[90629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6.info Apr 28 19:21:24 devstack sudo[90629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:24 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[169483fb-5b22-4b23-8955-70714a8d0aec]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:21:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a577dbbe-2301-4567-a3c9-fca0742f6aa0 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b2905753-39b2-4f3d-a483-0f4d803fa636 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:24 devstack sudo[90631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b2905753-39b2-4f3d-a483-0f4d803fa636 Apr 28 19:21:24 devstack sudo[90631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:24 devstack sudo[90629]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6.info" returned: 0 in 0.653s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:24 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6.info is being set with open permissions: ugo+rw Apr 28 19:21:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:24 devstack sudo[90636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6.info Apr 28 19:21:24 devstack sudo[90636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:24 devstack sudo[90631]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a577dbbe-2301-4567-a3c9-fca0742f6aa0 tempest-GroupSnapshotsTest-2116439637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b2905753-39b2-4f3d-a483-0f4d803fa636" returned: 0 in 0.774s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a577dbbe-2301-4567-a3c9-fca0742f6aa0 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b2905753-39b2-4f3d-a483-0f4d803fa636 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:24 devstack sudo[90639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b2905753-39b2-4f3d-a483-0f4d803fa636 Apr 28 19:21:24 devstack sudo[90639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:25 devstack sudo[90636]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6.info" returned: 0 in 0.674s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:25 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Acquiring lock "cinder-quobyte-86523126-1505-449c-b266-78be2d33609f" by "_copy_volume_from_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:21:25 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Lock "cinder-quobyte-86523126-1505-449c-b266-78be2d33609f" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:21:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] snapshot: 90e3ac9a-bdef-483c-ac79-46a98214267b, volume: 86523126-1505-449c-b266-78be2d33609f, {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 19:21:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:21:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:21:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:21:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:21:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:21:25 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[82733d29-a7eb-4fc0-8c9a-c868db2a6e63]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:21:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6.90e3ac9a-bdef-483c-ac79-46a98214267b {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:25 devstack sudo[90639]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a577dbbe-2301-4567-a3c9-fca0742f6aa0 tempest-GroupSnapshotsTest-2116439637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b2905753-39b2-4f3d-a483-0f4d803fa636" returned: 0 in 0.641s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:25 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a577dbbe-2301-4567-a3c9-fca0742f6aa0 tempest-GroupSnapshotsTest-2116439637 None] Lock "cinder-quobyte-b2905753-39b2-4f3d-a483-0f4d803fa636" released by "delete_volume" :: held 1.481s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:21:25 devstack sudo[90643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6.90e3ac9a-bdef-483c-ac79-46a98214267b Apr 28 19:21:25 devstack sudo[90643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:25 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-a577dbbe-2301-4567-a3c9-fca0742f6aa0 tempest-GroupSnapshotsTest-2116439637 None] Created reservations ['4239fadf-a739-4747-a2f2-178010670533'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:21:25 devstack cinder-volume[83863]: WARNING cinder.quota [None req-a577dbbe-2301-4567-a3c9-fca0742f6aa0 tempest-GroupSnapshotsTest-2116439637 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1208047567 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1208047567, it is now deprecated. Please use the default quota class for default quota. Apr 28 19:21:25 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-a577dbbe-2301-4567-a3c9-fca0742f6aa0 tempest-GroupSnapshotsTest-2116439637 None] Created reservations ['e22ccccf-9c1c-4317-a4de-d8a4453980d1', 'e9276560-85cd-4c59-aa62-07ea1a658fc9', 'f56cd8b9-8828-4dc4-914e-5a9146ffd623', 'f86ed479-8132-406c-aad1-4a472af72fde'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:21:25 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-a577dbbe-2301-4567-a3c9-fca0742f6aa0 tempest-GroupSnapshotsTest-2116439637 None] Created reservations ['8769165c-0b7a-40dc-ac56-11085b9391c5', '522ed5e4-6bb4-4b62-b476-64d110076cb8', 'd7fea5ae-3c4f-4c87-8c83-fbdcb36bdf4e', '4b667185-cc2d-4819-a773-7679cc950ac7'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:21:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a577dbbe-2301-4567-a3c9-fca0742f6aa0 tempest-GroupSnapshotsTest-2116439637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:21:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a577dbbe-2301-4567-a3c9-fca0742f6aa0 tempest-GroupSnapshotsTest-2116439637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:21:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a577dbbe-2301-4567-a3c9-fca0742f6aa0 tempest-GroupSnapshotsTest-2116439637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:21:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a577dbbe-2301-4567-a3c9-fca0742f6aa0 tempest-GroupSnapshotsTest-2116439637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:21:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a577dbbe-2301-4567-a3c9-fca0742f6aa0 tempest-GroupSnapshotsTest-2116439637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:21:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a577dbbe-2301-4567-a3c9-fca0742f6aa0 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:25 devstack sudo[90645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:21:25 devstack sudo[90645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:26 devstack sudo[90643]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6.90e3ac9a-bdef-483c-ac79-46a98214267b" returned: 0 in 0.789s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:26 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:21:26 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6 {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 19:21:26 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Creating direct copy from snapshot {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 19:21:26 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f46b59-ad7e-40fb-8859-ccb167455369]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:21:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:26 devstack sudo[90650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6 Apr 28 19:21:26 devstack sudo[90650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:26 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-1ba914fd-39b4-4b24-bd7e-487f1ae2d4db tempest-GroupSnapshotsTest-2116439637 None] Group tempest-GroupSnapshotsTest-Group-367238212: creating Apr 28 19:21:26 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-1ba914fd-39b4-4b24-bd7e-487f1ae2d4db tempest-GroupSnapshotsTest-2116439637 None] Group tempest-GroupSnapshotsTest-Group-367238212: created successfully Apr 28 19:21:26 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-1ba914fd-39b4-4b24-bd7e-487f1ae2d4db tempest-GroupSnapshotsTest-2116439637 None] Create group completed successfully. Apr 28 19:21:26 devstack sudo[90645]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a577dbbe-2301-4567-a3c9-fca0742f6aa0 tempest-GroupSnapshotsTest-2116439637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.649s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:26 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-a577dbbe-2301-4567-a3c9-fca0742f6aa0 tempest-GroupSnapshotsTest-2116439637 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:21:26 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-a577dbbe-2301-4567-a3c9-fca0742f6aa0 tempest-GroupSnapshotsTest-2116439637 None] Delete group completed successfully. Apr 28 19:21:27 devstack sudo[90650]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6" returned: 0 in 0.759s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:27 devstack cinder-volume[83863]: DEBUG cinder.utils [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Path /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-86523126-1505-449c-b266-78be2d33609f not found in is_blk_device check {{(pid=83863) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 19:21:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-86523126-1505-449c-b266-78be2d33609f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:27 devstack sudo[90657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-86523126-1505-449c-b266-78be2d33609f Apr 28 19:21:27 devstack sudo[90657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:28 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-af17c83d-288a-4c5b-81cc-44960b1549f9 tempest-GroupSnapshotsTest-2116439637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:21:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-af17c83d-288a-4c5b-81cc-44960b1549f9 tempest-GroupSnapshotsTest-2116439637 None] Flow 'volume_create_manager' (1af25cbc-b8fd-4b4c-8a58-79ff15650c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:21:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-af17c83d-288a-4c5b-81cc-44960b1549f9 tempest-GroupSnapshotsTest-2116439637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0639588-871d-47d8-b931-a2838f70246e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-af17c83d-288a-4c5b-81cc-44960b1549f9 tempest-GroupSnapshotsTest-2116439637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0639588-871d-47d8-b931-a2838f70246e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:21:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-471957032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=556180b6-bc6b-4111-a473-58db16138381,host='devstack@QuobyteHD#QuobyteHD',id=3bcf7f46-5c26-40e2-a896-ea473239ad73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e401e9fc3544a1d944049a2dd4e5750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:21:28Z,use_quota=True,user_id='f9e5c409ae3c4e69a21e97e35ff5de19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f672485d-3388-4117-805a-28c171e48cc5),volume_type_id=f672485d-3388-4117-805a-28c171e48cc5)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-af17c83d-288a-4c5b-81cc-44960b1549f9 tempest-GroupSnapshotsTest-2116439637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70857d31-797d-46e7-9797-e880d1bf2323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-af17c83d-288a-4c5b-81cc-44960b1549f9 tempest-GroupSnapshotsTest-2116439637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70857d31-797d-46e7-9797-e880d1bf2323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-af17c83d-288a-4c5b-81cc-44960b1549f9 tempest-GroupSnapshotsTest-2116439637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f43f28ef-c686-42f0-b6c9-98c7bff9353d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-af17c83d-288a-4c5b-81cc-44960b1549f9 tempest-GroupSnapshotsTest-2116439637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f43f28ef-c686-42f0-b6c9-98c7bff9353d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bcf7f46-5c26-40e2-a896-ea473239ad73', 'volume_name': 'volume-3bcf7f46-5c26-40e2-a896-ea473239ad73', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-af17c83d-288a-4c5b-81cc-44960b1549f9 tempest-GroupSnapshotsTest-2116439637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe5f246c-3ca1-4537-8d08-e943f128cef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-af17c83d-288a-4c5b-81cc-44960b1549f9 tempest-GroupSnapshotsTest-2116439637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe5f246c-3ca1-4537-8d08-e943f128cef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-af17c83d-288a-4c5b-81cc-44960b1549f9 tempest-GroupSnapshotsTest-2116439637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f399d8c-513d-427b-b050-e2b39af390a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:28 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-af17c83d-288a-4c5b-81cc-44960b1549f9 tempest-GroupSnapshotsTest-2116439637 None] Volume 3bcf7f46-5c26-40e2-a896-ea473239ad73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bcf7f46-5c26-40e2-a896-ea473239ad73', 'volume_size': 1} Apr 28 19:21:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-af17c83d-288a-4c5b-81cc-44960b1549f9 tempest-GroupSnapshotsTest-2116439637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:21:31 devstack sudo[90657]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-86523126-1505-449c-b266-78be2d33609f" returned: 0 in 4.775s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:31 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f6af8f-e0dd-4c50-ab78-14a009f7428e]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:21:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:31 devstack sudo[90671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6 Apr 28 19:21:31 devstack sudo[90671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:32 devstack sudo[90671]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6" returned: 0 in 0.871s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:32 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Image conversion details: src /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6, size 1024.00 MB, duration 4.78 sec, destination /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-86523126-1505-449c-b266-78be2d33609f {{(pid=83863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 19:21:32 devstack cinder-volume[83863]: INFO cinder.image.image_utils [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Converted 1024.00 MB image at 214.40 MB/s Apr 28 19:21:32 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-86523126-1505-449c-b266-78be2d33609f is being set with open permissions: ugo+rw Apr 28 19:21:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-86523126-1505-449c-b266-78be2d33609f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:32 devstack sudo[90677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-86523126-1505-449c-b266-78be2d33609f Apr 28 19:21:32 devstack sudo[90677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:33 devstack sudo[90677]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-86523126-1505-449c-b266-78be2d33609f" returned: 0 in 0.597s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:33 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Lock "cinder-quobyte-86523126-1505-449c-b266-78be2d33609f" released by "_copy_volume_from_snapshot" :: held 7.880s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:21:33 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Acquiring lock "cinder-quobyte-90e3ac9a-bdef-483c-ac79-46a98214267b" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:21:33 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Lock "cinder-quobyte-90e3ac9a-bdef-483c-ac79-46a98214267b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:21:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Deleting offline snapshot 90e3ac9a-bdef-483c-ac79-46a98214267b of volume 01a2bf25-4ee1-4407-8151-a98f3d0a27e6 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 19:21:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] snapshot_file for this snap is: volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6.90e3ac9a-bdef-483c-ac79-46a98214267b {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 19:21:33 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b253f10f-2acb-4322-98e9-320e68b61b6d]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:21:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6.90e3ac9a-bdef-483c-ac79-46a98214267b {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:33 devstack sudo[90680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6.90e3ac9a-bdef-483c-ac79-46a98214267b Apr 28 19:21:33 devstack sudo[90680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:34 devstack sudo[90680]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6.90e3ac9a-bdef-483c-ac79-46a98214267b" returned: 0 in 0.724s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:34 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:21:34 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4558eebe-4a59-4987-87c8-2f36248e84ec]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:21:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:34 devstack sudo[90685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6 Apr 28 19:21:34 devstack sudo[90685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:34 devstack sudo[90685]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6" returned: 0 in 0.697s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6.90e3ac9a-bdef-483c-ac79-46a98214267b {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:34 devstack sudo[90690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6.90e3ac9a-bdef-483c-ac79-46a98214267b Apr 28 19:21:34 devstack sudo[90690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:35 devstack sudo[90690]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6.90e3ac9a-bdef-483c-ac79-46a98214267b" returned: 0 in 0.669s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6.90e3ac9a-bdef-483c-ac79-46a98214267b {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:35 devstack sudo[90695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6.90e3ac9a-bdef-483c-ac79-46a98214267b Apr 28 19:21:35 devstack sudo[90695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:36 devstack sudo[90695]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6.90e3ac9a-bdef-483c-ac79-46a98214267b" returned: 0 in 0.588s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:36 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Lock "cinder-quobyte-90e3ac9a-bdef-483c-ac79-46a98214267b" released by "_delete_snapshot" :: held 2.762s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:21:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.087s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:21:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-04c069dc-eb4a-4ba8-bd74-a9c986f204d0 tempest-VolumesDeleteCascade-1370866783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.883s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:21:36 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6acde0f-76d8-486f-90f5-cc3a5c0905ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86523126-1505-449c-b266-78be2d33609f', 'volume_size': 1, 'source_volid': '01a2bf25-4ee1-4407-8151-a98f3d0a27e6', 'source_volstatus': 'available'}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:36 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92a45811-53d1-4101-aca7-d11be401d898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:36 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-04c069dc-eb4a-4ba8-bd74-a9c986f204d0 tempest-VolumesDeleteCascade-1370866783 None] Creating offline snapshot fa7130c6-49d7-4ecd-8fdd-75da245b6c5f of volume 3b433099-f391-418c-92e9-35fff14bead7 {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 19:21:36 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Volume volume-86523126-1505-449c-b266-78be2d33609f (86523126-1505-449c-b266-78be2d33609f): created successfully Apr 28 19:21:36 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92a45811-53d1-4101-aca7-d11be401d898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:36 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Flow 'volume_create_manager' (d51b5980-0e48-477a-a48c-89dd5ef81c65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:21:36 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa650ef-809e-4e8e-b5f8-82cd30075fef]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:21:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-04c069dc-eb4a-4ba8-bd74-a9c986f204d0 tempest-VolumesDeleteCascade-1370866783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.503a0b1b-12bb-4478-81c7-cd193875b72f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:36 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-7a82ce55-12df-484f-9825-f9ae96983742 tempest-VolumesGetTest-711720961 None] Created volume successfully. Apr 28 19:21:36 devstack sudo[90732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.503a0b1b-12bb-4478-81c7-cd193875b72f Apr 28 19:21:36 devstack sudo[90732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:36 devstack sudo[90732]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-04c069dc-eb4a-4ba8-bd74-a9c986f204d0 tempest-VolumesDeleteCascade-1370866783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.503a0b1b-12bb-4478-81c7-cd193875b72f" returned: 0 in 0.731s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:36 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-04c069dc-eb4a-4ba8-bd74-a9c986f204d0 tempest-VolumesDeleteCascade-1370866783 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b433099-f391-418c-92e9-35fff14bead7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:21:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-04c069dc-eb4a-4ba8-bd74-a9c986f204d0 tempest-VolumesDeleteCascade-1370866783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.503a0b1b-12bb-4478-81c7-cd193875b72f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.fa7130c6-49d7-4ecd-8fdd-75da245b6c5f 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:37 devstack sudo[90739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.503a0b1b-12bb-4478-81c7-cd193875b72f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.fa7130c6-49d7-4ecd-8fdd-75da245b6c5f 1G Apr 28 19:21:37 devstack sudo[90739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:37 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-c32132fb-a4dd-4529-9c0a-55217fadf921 tempest-VolumesGetTest-711720961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:21:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c32132fb-a4dd-4529-9c0a-55217fadf921 tempest-VolumesGetTest-711720961 None] Flow 'volume_create_manager' (7fa08988-0c14-401a-985e-3b41a2578c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:21:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c32132fb-a4dd-4529-9c0a-55217fadf921 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8ccc2d7-2098-433d-87f6-d7df07e2a409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c32132fb-a4dd-4529-9c0a-55217fadf921 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8ccc2d7-2098-433d-87f6-d7df07e2a409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:21:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1607030957',display_name='tempest-VolumesGetTest-Volume-972176596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3c25349-99e4-4b3b-9fdd-1a9c0d390bf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8969a99ceb4c87b83e42ed49dfe036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:21:37Z,use_quota=True,user_id='49def545e71141ef8b767db7c433c4f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c32132fb-a4dd-4529-9c0a-55217fadf921 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e44551d0-5363-4d9d-ab61-b65878867020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c32132fb-a4dd-4529-9c0a-55217fadf921 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e44551d0-5363-4d9d-ab61-b65878867020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c32132fb-a4dd-4529-9c0a-55217fadf921 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3088e581-f4b0-48ce-845e-1a0239e7770c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c32132fb-a4dd-4529-9c0a-55217fadf921 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3088e581-f4b0-48ce-845e-1a0239e7770c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3c25349-99e4-4b3b-9fdd-1a9c0d390bf6', 'volume_name': 'volume-d3c25349-99e4-4b3b-9fdd-1a9c0d390bf6', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c32132fb-a4dd-4529-9c0a-55217fadf921 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f5ae232-d15d-4673-9ac7-74e0b4b546db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c32132fb-a4dd-4529-9c0a-55217fadf921 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f5ae232-d15d-4673-9ac7-74e0b4b546db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c32132fb-a4dd-4529-9c0a-55217fadf921 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5892d44-3b5a-41fe-9aee-56702f853841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:37 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-c32132fb-a4dd-4529-9c0a-55217fadf921 tempest-VolumesGetTest-711720961 None] Volume d3c25349-99e4-4b3b-9fdd-1a9c0d390bf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3c25349-99e4-4b3b-9fdd-1a9c0d390bf6', 'volume_size': 1} Apr 28 19:21:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c32132fb-a4dd-4529-9c0a-55217fadf921 tempest-VolumesGetTest-711720961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:21:37 devstack sudo[90739]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-04c069dc-eb4a-4ba8-bd74-a9c986f204d0 tempest-VolumesDeleteCascade-1370866783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.503a0b1b-12bb-4478-81c7-cd193875b72f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.fa7130c6-49d7-4ecd-8fdd-75da245b6c5f 1G" returned: 0 in 0.793s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-04c069dc-eb4a-4ba8-bd74-a9c986f204d0 tempest-VolumesDeleteCascade-1370866783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b433099-f391-418c-92e9-35fff14bead7.503a0b1b-12bb-4478-81c7-cd193875b72f -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.fa7130c6-49d7-4ecd-8fdd-75da245b6c5f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:37 devstack sudo[90744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b433099-f391-418c-92e9-35fff14bead7.503a0b1b-12bb-4478-81c7-cd193875b72f -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.fa7130c6-49d7-4ecd-8fdd-75da245b6c5f Apr 28 19:21:37 devstack sudo[90744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:38 devstack sudo[90744]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-04c069dc-eb4a-4ba8-bd74-a9c986f204d0 tempest-VolumesDeleteCascade-1370866783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b433099-f391-418c-92e9-35fff14bead7.503a0b1b-12bb-4478-81c7-cd193875b72f -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.fa7130c6-49d7-4ecd-8fdd-75da245b6c5f" returned: 0 in 0.661s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:38 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-04c069dc-eb4a-4ba8-bd74-a9c986f204d0 tempest-VolumesDeleteCascade-1370866783 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.fa7130c6-49d7-4ecd-8fdd-75da245b6c5f is being set with open permissions: ugo+rw Apr 28 19:21:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-04c069dc-eb4a-4ba8-bd74-a9c986f204d0 tempest-VolumesDeleteCascade-1370866783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.fa7130c6-49d7-4ecd-8fdd-75da245b6c5f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:38 devstack sudo[90749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.fa7130c6-49d7-4ecd-8fdd-75da245b6c5f Apr 28 19:21:38 devstack sudo[90749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:39 devstack sudo[90749]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-04c069dc-eb4a-4ba8-bd74-a9c986f204d0 tempest-VolumesDeleteCascade-1370866783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.fa7130c6-49d7-4ecd-8fdd-75da245b6c5f" returned: 0 in 0.602s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-04c069dc-eb4a-4ba8-bd74-a9c986f204d0 tempest-VolumesDeleteCascade-1370866783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.915s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:21:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-af17c83d-288a-4c5b-81cc-44960b1549f9 tempest-GroupSnapshotsTest-2116439637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.847s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:21:39 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-af17c83d-288a-4c5b-81cc-44960b1549f9 tempest-GroupSnapshotsTest-2116439637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=556180b6-bc6b-4111-a473-58db16138381,created_at=2026-04-28T17:21:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-471957032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=556180b6-bc6b-4111-a473-58db16138381,host='devstack@QuobyteHD#QuobyteHD',id=3bcf7f46-5c26-40e2-a896-ea473239ad73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e401e9fc3544a1d944049a2dd4e5750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:21:28Z,use_quota=True,user_id='f9e5c409ae3c4e69a21e97e35ff5de19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f672485d-3388-4117-805a-28c171e48cc5),volume_type_id=f672485d-3388-4117-805a-28c171e48cc5)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:21:39 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-af17c83d-288a-4c5b-81cc-44960b1549f9 tempest-GroupSnapshotsTest-2116439637 None] Creating volume 3bcf7f46-5c26-40e2-a896-ea473239ad73 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:21:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-af17c83d-288a-4c5b-81cc-44960b1549f9 tempest-GroupSnapshotsTest-2116439637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:21:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-af17c83d-288a-4c5b-81cc-44960b1549f9 tempest-GroupSnapshotsTest-2116439637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:21:39 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-af17c83d-288a-4c5b-81cc-44960b1549f9 tempest-GroupSnapshotsTest-2116439637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:21:39 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-af17c83d-288a-4c5b-81cc-44960b1549f9 tempest-GroupSnapshotsTest-2116439637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:21:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-af17c83d-288a-4c5b-81cc-44960b1549f9 tempest-GroupSnapshotsTest-2116439637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:21:39 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-af17c83d-288a-4c5b-81cc-44960b1549f9 tempest-GroupSnapshotsTest-2116439637 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:21:39 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-af17c83d-288a-4c5b-81cc-44960b1549f9 tempest-GroupSnapshotsTest-2116439637 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:21:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-af17c83d-288a-4c5b-81cc-44960b1549f9 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3bcf7f46-5c26-40e2-a896-ea473239ad73 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:39 devstack sudo[90752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3bcf7f46-5c26-40e2-a896-ea473239ad73 1073741824 Apr 28 19:21:39 devstack sudo[90752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:39 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-04c069dc-eb4a-4ba8-bd74-a9c986f204d0 tempest-VolumesDeleteCascade-1370866783 None] Create snapshot completed successfully Apr 28 19:21:39 devstack sudo[90752]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-af17c83d-288a-4c5b-81cc-44960b1549f9 tempest-GroupSnapshotsTest-2116439637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3bcf7f46-5c26-40e2-a896-ea473239ad73 1073741824" returned: 0 in 0.757s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-af17c83d-288a-4c5b-81cc-44960b1549f9 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3bcf7f46-5c26-40e2-a896-ea473239ad73 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:39 devstack sudo[90757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3bcf7f46-5c26-40e2-a896-ea473239ad73 Apr 28 19:21:39 devstack sudo[90757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:40 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Acquiring lock "cinder-3b433099-f391-418c-92e9-35fff14bead7-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:21:40 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Lock "cinder-3b433099-f391-418c-92e9-35fff14bead7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:21:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Performing cascade delete. {{(pid=83863) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 28 19:21:40 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Acquiring lock "cinder-503a0b1b-12bb-4478-81c7-cd193875b72f-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:21:40 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Lock "cinder-503a0b1b-12bb-4478-81c7-cd193875b72f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:21:40 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Acquiring lock "cinder-quobyte-3b433099-f391-418c-92e9-35fff14bead7" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:21:40 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Lock "cinder-quobyte-3b433099-f391-418c-92e9-35fff14bead7" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:21:40 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Acquiring lock "cinder-quobyte-503a0b1b-12bb-4478-81c7-cd193875b72f" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:21:40 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Lock "cinder-quobyte-503a0b1b-12bb-4478-81c7-cd193875b72f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:21:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Deleting offline snapshot 503a0b1b-12bb-4478-81c7-cd193875b72f of volume 3b433099-f391-418c-92e9-35fff14bead7 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 19:21:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] snapshot_file for this snap is: volume-3b433099-f391-418c-92e9-35fff14bead7.503a0b1b-12bb-4478-81c7-cd193875b72f {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 19:21:40 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dea9886-6dd5-4fcc-bf18-ad9ad72d62a8]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:21:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.503a0b1b-12bb-4478-81c7-cd193875b72f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:40 devstack sudo[90759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.503a0b1b-12bb-4478-81c7-cd193875b72f Apr 28 19:21:40 devstack sudo[90759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:40 devstack sudo[90757]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-af17c83d-288a-4c5b-81cc-44960b1549f9 tempest-GroupSnapshotsTest-2116439637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3bcf7f46-5c26-40e2-a896-ea473239ad73" returned: 0 in 0.610s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-af17c83d-288a-4c5b-81cc-44960b1549f9 tempest-GroupSnapshotsTest-2116439637 None] <== create_volume: return (1404ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:21:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-af17c83d-288a-4c5b-81cc-44960b1549f9 tempest-GroupSnapshotsTest-2116439637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.407s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:21:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c32132fb-a4dd-4529-9c0a-55217fadf921 tempest-VolumesGetTest-711720961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.972s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:21:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c32132fb-a4dd-4529-9c0a-55217fadf921 tempest-VolumesGetTest-711720961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:21:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1607030957',display_name='tempest-VolumesGetTest-Volume-972176596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3c25349-99e4-4b3b-9fdd-1a9c0d390bf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8969a99ceb4c87b83e42ed49dfe036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:21:37Z,use_quota=True,user_id='49def545e71141ef8b767db7c433c4f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:21:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-c32132fb-a4dd-4529-9c0a-55217fadf921 tempest-VolumesGetTest-711720961 None] Creating volume d3c25349-99e4-4b3b-9fdd-1a9c0d390bf6 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:21:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c32132fb-a4dd-4529-9c0a-55217fadf921 tempest-VolumesGetTest-711720961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:21:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c32132fb-a4dd-4529-9c0a-55217fadf921 tempest-VolumesGetTest-711720961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:21:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c32132fb-a4dd-4529-9c0a-55217fadf921 tempest-VolumesGetTest-711720961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:21:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c32132fb-a4dd-4529-9c0a-55217fadf921 tempest-VolumesGetTest-711720961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:21:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c32132fb-a4dd-4529-9c0a-55217fadf921 tempest-VolumesGetTest-711720961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:21:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c32132fb-a4dd-4529-9c0a-55217fadf921 tempest-VolumesGetTest-711720961 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:21:40 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-c32132fb-a4dd-4529-9c0a-55217fadf921 tempest-VolumesGetTest-711720961 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:21:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c32132fb-a4dd-4529-9c0a-55217fadf921 tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d3c25349-99e4-4b3b-9fdd-1a9c0d390bf6 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-af17c83d-288a-4c5b-81cc-44960b1549f9 tempest-GroupSnapshotsTest-2116439637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f399d8c-513d-427b-b050-e2b39af390a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bcf7f46-5c26-40e2-a896-ea473239ad73', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-af17c83d-288a-4c5b-81cc-44960b1549f9 tempest-GroupSnapshotsTest-2116439637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (524bc689-98f9-413d-b081-f864a490d70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:40 devstack sudo[90762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d3c25349-99e4-4b3b-9fdd-1a9c0d390bf6 1073741824 Apr 28 19:21:40 devstack sudo[90762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:40 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-af17c83d-288a-4c5b-81cc-44960b1549f9 tempest-GroupSnapshotsTest-2116439637 None] Volume volume-3bcf7f46-5c26-40e2-a896-ea473239ad73 (3bcf7f46-5c26-40e2-a896-ea473239ad73): created successfully Apr 28 19:21:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-af17c83d-288a-4c5b-81cc-44960b1549f9 tempest-GroupSnapshotsTest-2116439637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (524bc689-98f9-413d-b081-f864a490d70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-af17c83d-288a-4c5b-81cc-44960b1549f9 tempest-GroupSnapshotsTest-2116439637 None] Flow 'volume_create_manager' (1af25cbc-b8fd-4b4c-8a58-79ff15650c99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:21:40 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-af17c83d-288a-4c5b-81cc-44960b1549f9 tempest-GroupSnapshotsTest-2116439637 None] Created volume successfully. Apr 28 19:21:40 devstack sudo[90759]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.503a0b1b-12bb-4478-81c7-cd193875b72f" returned: 0 in 0.758s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b433099-f391-418c-92e9-35fff14bead7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:21:40 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4761c2c-5cfa-4e02-b3b0-8086ec529020]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:21:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:41 devstack sudo[90768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7 Apr 28 19:21:41 devstack sudo[90768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:41 devstack sudo[90762]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c32132fb-a4dd-4529-9c0a-55217fadf921 tempest-VolumesGetTest-711720961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d3c25349-99e4-4b3b-9fdd-1a9c0d390bf6 1073741824" returned: 0 in 0.815s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c32132fb-a4dd-4529-9c0a-55217fadf921 tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d3c25349-99e4-4b3b-9fdd-1a9c0d390bf6 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:41 devstack sudo[90773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d3c25349-99e4-4b3b-9fdd-1a9c0d390bf6 Apr 28 19:21:41 devstack sudo[90773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:41 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-59ac3e9d-877d-4ac0-97ba-d47facf2c480 tempest-GroupSnapshotsTest-2116439637 None] GroupSnapshot af660ad3-c062-4d77-9985-d06015834b57: creating. Apr 28 19:21:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-59ac3e9d-877d-4ac0-97ba-d47facf2c480 tempest-GroupSnapshotsTest-2116439637 None] Group snapshot af660ad3-c062-4d77-9985-d06015834b57: creating. {{(pid=83863) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 28 19:21:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-59ac3e9d-877d-4ac0-97ba-d47facf2c480 tempest-GroupSnapshotsTest-2116439637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:21:41 devstack sudo[90768]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7" returned: 0 in 0.779s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:41 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[411b5774-d9af-496e-8005-f71466fb1314]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:21:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.fa7130c6-49d7-4ecd-8fdd-75da245b6c5f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:41 devstack sudo[90778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.fa7130c6-49d7-4ecd-8fdd-75da245b6c5f Apr 28 19:21:41 devstack sudo[90778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:42 devstack sudo[90773]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c32132fb-a4dd-4529-9c0a-55217fadf921 tempest-VolumesGetTest-711720961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d3c25349-99e4-4b3b-9fdd-1a9c0d390bf6" returned: 0 in 0.663s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:42 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c32132fb-a4dd-4529-9c0a-55217fadf921 tempest-VolumesGetTest-711720961 None] <== create_volume: return (1528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:21:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c32132fb-a4dd-4529-9c0a-55217fadf921 tempest-VolumesGetTest-711720961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.531s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:21:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-59ac3e9d-877d-4ac0-97ba-d47facf2c480 tempest-GroupSnapshotsTest-2116439637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.374s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:21:42 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-59ac3e9d-877d-4ac0-97ba-d47facf2c480 tempest-GroupSnapshotsTest-2116439637 None] Creating offline snapshot 7b12bdb2-d701-4d66-8d84-9ba23ab2f840 of volume 3bcf7f46-5c26-40e2-a896-ea473239ad73 {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 19:21:42 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c32132fb-a4dd-4529-9c0a-55217fadf921 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5892d44-3b5a-41fe-9aee-56702f853841) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3c25349-99e4-4b3b-9fdd-1a9c0d390bf6', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:42 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c32132fb-a4dd-4529-9c0a-55217fadf921 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a734ea1-912c-48b1-9c57-5ba152465ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:42 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f6509a-658f-4309-8247-baad3448db43]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:21:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-59ac3e9d-877d-4ac0-97ba-d47facf2c480 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3bcf7f46-5c26-40e2-a896-ea473239ad73 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:42 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-c32132fb-a4dd-4529-9c0a-55217fadf921 tempest-VolumesGetTest-711720961 None] Volume volume-d3c25349-99e4-4b3b-9fdd-1a9c0d390bf6 (d3c25349-99e4-4b3b-9fdd-1a9c0d390bf6): created successfully Apr 28 19:21:42 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c32132fb-a4dd-4529-9c0a-55217fadf921 tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a734ea1-912c-48b1-9c57-5ba152465ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:42 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c32132fb-a4dd-4529-9c0a-55217fadf921 tempest-VolumesGetTest-711720961 None] Flow 'volume_create_manager' (7fa08988-0c14-401a-985e-3b41a2578c88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:21:42 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-c32132fb-a4dd-4529-9c0a-55217fadf921 tempest-VolumesGetTest-711720961 None] Created volume successfully. Apr 28 19:21:42 devstack sudo[90781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3bcf7f46-5c26-40e2-a896-ea473239ad73 Apr 28 19:21:42 devstack sudo[90781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:42 devstack sudo[90778]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.fa7130c6-49d7-4ecd-8fdd-75da245b6c5f" returned: 0 in 0.699s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:42 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b433099-f391-418c-92e9-35fff14bead7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:21:42 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa0927c-b7e9-4de6-b7ec-fd0f838853f5]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:21:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.503a0b1b-12bb-4478-81c7-cd193875b72f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:42 devstack sudo[90786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.503a0b1b-12bb-4478-81c7-cd193875b72f Apr 28 19:21:42 devstack sudo[90786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:42 devstack sudo[90781]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-59ac3e9d-877d-4ac0-97ba-d47facf2c480 tempest-GroupSnapshotsTest-2116439637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3bcf7f46-5c26-40e2-a896-ea473239ad73" returned: 0 in 0.766s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-59ac3e9d-877d-4ac0-97ba-d47facf2c480 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3bcf7f46-5c26-40e2-a896-ea473239ad73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3bcf7f46-5c26-40e2-a896-ea473239ad73.7b12bdb2-d701-4d66-8d84-9ba23ab2f840 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:42 devstack sudo[90791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3bcf7f46-5c26-40e2-a896-ea473239ad73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3bcf7f46-5c26-40e2-a896-ea473239ad73.7b12bdb2-d701-4d66-8d84-9ba23ab2f840 1G Apr 28 19:21:42 devstack sudo[90791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:42 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-caeb603c-703f-4bdd-bd79-85b60d636acb tempest-VolumesGetTest-711720961 None] Acquiring lock "cinder-d3c25349-99e4-4b3b-9fdd-1a9c0d390bf6-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:21:42 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-caeb603c-703f-4bdd-bd79-85b60d636acb tempest-VolumesGetTest-711720961 None] Lock "cinder-d3c25349-99e4-4b3b-9fdd-1a9c0d390bf6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:21:42 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-caeb603c-703f-4bdd-bd79-85b60d636acb tempest-VolumesGetTest-711720961 None] Acquiring lock "cinder-quobyte-d3c25349-99e4-4b3b-9fdd-1a9c0d390bf6" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:21:42 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-caeb603c-703f-4bdd-bd79-85b60d636acb tempest-VolumesGetTest-711720961 None] Lock "cinder-quobyte-d3c25349-99e4-4b3b-9fdd-1a9c0d390bf6" acquired by "delete_volume" :: waited 0.017s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:21:43 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5668f817-490b-4c18-9270-bafc74f3b12c]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:21:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-caeb603c-703f-4bdd-bd79-85b60d636acb tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d3c25349-99e4-4b3b-9fdd-1a9c0d390bf6 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:43 devstack sudo[90793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d3c25349-99e4-4b3b-9fdd-1a9c0d390bf6 Apr 28 19:21:43 devstack sudo[90793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:43 devstack sudo[90786]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.503a0b1b-12bb-4478-81c7-cd193875b72f" returned: 0 in 0.774s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:43 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b433099-f391-418c-92e9-35fff14bead7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:21:43 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b13a86-033d-425b-ac62-1032a727bc3c]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:21:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:43 devstack sudo[90798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7 Apr 28 19:21:43 devstack sudo[90798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:43 devstack sudo[90791]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-59ac3e9d-877d-4ac0-97ba-d47facf2c480 tempest-GroupSnapshotsTest-2116439637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3bcf7f46-5c26-40e2-a896-ea473239ad73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3bcf7f46-5c26-40e2-a896-ea473239ad73.7b12bdb2-d701-4d66-8d84-9ba23ab2f840 1G" returned: 0 in 0.798s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-59ac3e9d-877d-4ac0-97ba-d47facf2c480 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bcf7f46-5c26-40e2-a896-ea473239ad73 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3bcf7f46-5c26-40e2-a896-ea473239ad73.7b12bdb2-d701-4d66-8d84-9ba23ab2f840 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:43 devstack sudo[90805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bcf7f46-5c26-40e2-a896-ea473239ad73 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3bcf7f46-5c26-40e2-a896-ea473239ad73.7b12bdb2-d701-4d66-8d84-9ba23ab2f840 Apr 28 19:21:43 devstack sudo[90805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:43 devstack sudo[90793]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-caeb603c-703f-4bdd-bd79-85b60d636acb tempest-VolumesGetTest-711720961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d3c25349-99e4-4b3b-9fdd-1a9c0d390bf6" returned: 0 in 0.796s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-caeb603c-703f-4bdd-bd79-85b60d636acb tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d3c25349-99e4-4b3b-9fdd-1a9c0d390bf6 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:43 devstack sudo[90809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d3c25349-99e4-4b3b-9fdd-1a9c0d390bf6 Apr 28 19:21:43 devstack sudo[90809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:44 devstack sudo[90798]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7" returned: 0 in 0.736s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.503a0b1b-12bb-4478-81c7-cd193875b72f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:44 devstack sudo[90814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.503a0b1b-12bb-4478-81c7-cd193875b72f Apr 28 19:21:44 devstack sudo[90814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:44 devstack sudo[90805]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-59ac3e9d-877d-4ac0-97ba-d47facf2c480 tempest-GroupSnapshotsTest-2116439637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bcf7f46-5c26-40e2-a896-ea473239ad73 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3bcf7f46-5c26-40e2-a896-ea473239ad73.7b12bdb2-d701-4d66-8d84-9ba23ab2f840" returned: 0 in 0.684s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:44 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-59ac3e9d-877d-4ac0-97ba-d47facf2c480 tempest-GroupSnapshotsTest-2116439637 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3bcf7f46-5c26-40e2-a896-ea473239ad73.7b12bdb2-d701-4d66-8d84-9ba23ab2f840 is being set with open permissions: ugo+rw: NotImplementedError Apr 28 19:21:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-59ac3e9d-877d-4ac0-97ba-d47facf2c480 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3bcf7f46-5c26-40e2-a896-ea473239ad73.7b12bdb2-d701-4d66-8d84-9ba23ab2f840 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:44 devstack sudo[90820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3bcf7f46-5c26-40e2-a896-ea473239ad73.7b12bdb2-d701-4d66-8d84-9ba23ab2f840 Apr 28 19:21:44 devstack sudo[90820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:44 devstack sudo[90809]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-caeb603c-703f-4bdd-bd79-85b60d636acb tempest-VolumesGetTest-711720961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d3c25349-99e4-4b3b-9fdd-1a9c0d390bf6" returned: 0 in 0.632s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:44 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-caeb603c-703f-4bdd-bd79-85b60d636acb tempest-VolumesGetTest-711720961 None] Lock "cinder-quobyte-d3c25349-99e4-4b3b-9fdd-1a9c0d390bf6" released by "delete_volume" :: held 1.477s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:21:44 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-caeb603c-703f-4bdd-bd79-85b60d636acb tempest-VolumesGetTest-711720961 None] Created reservations ['cdff157c-b5cc-4898-ab93-7b006f6f8615', 'f3012183-c17d-4910-a626-d4e15e2239df', 'eec51e2d-3767-4845-8d89-f71ec523fefe', 'c5029b61-ec77-4cc0-b81d-4f870737f93a'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:21:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-caeb603c-703f-4bdd-bd79-85b60d636acb tempest-VolumesGetTest-711720961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:21:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-caeb603c-703f-4bdd-bd79-85b60d636acb tempest-VolumesGetTest-711720961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:21:44 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-caeb603c-703f-4bdd-bd79-85b60d636acb tempest-VolumesGetTest-711720961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:21:44 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-caeb603c-703f-4bdd-bd79-85b60d636acb tempest-VolumesGetTest-711720961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:21:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-caeb603c-703f-4bdd-bd79-85b60d636acb tempest-VolumesGetTest-711720961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:21:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-caeb603c-703f-4bdd-bd79-85b60d636acb tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:44 devstack sudo[90825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:21:44 devstack sudo[90825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:44 devstack sudo[90814]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.503a0b1b-12bb-4478-81c7-cd193875b72f" returned: 0 in 0.734s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.503a0b1b-12bb-4478-81c7-cd193875b72f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:44 devstack sudo[90828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.503a0b1b-12bb-4478-81c7-cd193875b72f Apr 28 19:21:44 devstack sudo[90828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:44 devstack sudo[90820]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-59ac3e9d-877d-4ac0-97ba-d47facf2c480 tempest-GroupSnapshotsTest-2116439637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3bcf7f46-5c26-40e2-a896-ea473239ad73.7b12bdb2-d701-4d66-8d84-9ba23ab2f840" returned: 0 in 0.675s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-59ac3e9d-877d-4ac0-97ba-d47facf2c480 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3bcf7f46-5c26-40e2-a896-ea473239ad73.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:45 devstack sudo[90831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3bcf7f46-5c26-40e2-a896-ea473239ad73.info Apr 28 19:21:45 devstack sudo[90831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:45 devstack sudo[90825]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:45 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cb8f8d32-9601-4d55-8d9d-f9868aa20ca3 tempest-VolumesGetTest-711720961 None] Acquiring lock "cinder-86523126-1505-449c-b266-78be2d33609f-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:21:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-caeb603c-703f-4bdd-bd79-85b60d636acb tempest-VolumesGetTest-711720961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.631s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:45 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-caeb603c-703f-4bdd-bd79-85b60d636acb tempest-VolumesGetTest-711720961 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:21:45 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-caeb603c-703f-4bdd-bd79-85b60d636acb tempest-VolumesGetTest-711720961 None] Deleted volume successfully. Apr 28 19:21:45 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cb8f8d32-9601-4d55-8d9d-f9868aa20ca3 tempest-VolumesGetTest-711720961 None] Lock "cinder-86523126-1505-449c-b266-78be2d33609f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:21:45 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-caeb603c-703f-4bdd-bd79-85b60d636acb tempest-VolumesGetTest-711720961 None] Lock "cinder-d3c25349-99e4-4b3b-9fdd-1a9c0d390bf6-delete_volume" released by "delete_volume" :: held 2.340s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:21:45 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cb8f8d32-9601-4d55-8d9d-f9868aa20ca3 tempest-VolumesGetTest-711720961 None] Acquiring lock "cinder-quobyte-86523126-1505-449c-b266-78be2d33609f" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:21:45 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cb8f8d32-9601-4d55-8d9d-f9868aa20ca3 tempest-VolumesGetTest-711720961 None] Lock "cinder-quobyte-86523126-1505-449c-b266-78be2d33609f" acquired by "delete_volume" :: waited 0.019s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:21:45 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d5d237-6160-47df-bd91-b32aaf4ace39]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:21:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cb8f8d32-9601-4d55-8d9d-f9868aa20ca3 tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-86523126-1505-449c-b266-78be2d33609f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:45 devstack sudo[90828]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.503a0b1b-12bb-4478-81c7-cd193875b72f" returned: 0 in 0.668s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b433099-f391-418c-92e9-35fff14bead7 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.fa7130c6-49d7-4ecd-8fdd-75da245b6c5f -F qcow2 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:45 devstack sudo[90835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-86523126-1505-449c-b266-78be2d33609f Apr 28 19:21:45 devstack sudo[90835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:45 devstack sudo[90836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b433099-f391-418c-92e9-35fff14bead7 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.fa7130c6-49d7-4ecd-8fdd-75da245b6c5f -F qcow2 Apr 28 19:21:45 devstack sudo[90836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:45 devstack sudo[90831]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-59ac3e9d-877d-4ac0-97ba-d47facf2c480 tempest-GroupSnapshotsTest-2116439637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3bcf7f46-5c26-40e2-a896-ea473239ad73.info" returned: 0 in 0.685s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:45 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-59ac3e9d-877d-4ac0-97ba-d47facf2c480 tempest-GroupSnapshotsTest-2116439637 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3bcf7f46-5c26-40e2-a896-ea473239ad73.info is being set with open permissions: ugo+rw: NotImplementedError Apr 28 19:21:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-59ac3e9d-877d-4ac0-97ba-d47facf2c480 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3bcf7f46-5c26-40e2-a896-ea473239ad73.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:45 devstack sudo[90840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3bcf7f46-5c26-40e2-a896-ea473239ad73.info Apr 28 19:21:45 devstack sudo[90840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:46 devstack sudo[90835]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cb8f8d32-9601-4d55-8d9d-f9868aa20ca3 tempest-VolumesGetTest-711720961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-86523126-1505-449c-b266-78be2d33609f" returned: 0 in 0.754s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cb8f8d32-9601-4d55-8d9d-f9868aa20ca3 tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-86523126-1505-449c-b266-78be2d33609f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:46 devstack sudo[90854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-86523126-1505-449c-b266-78be2d33609f Apr 28 19:21:46 devstack sudo[90854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:46 devstack sudo[90836]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b433099-f391-418c-92e9-35fff14bead7 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.fa7130c6-49d7-4ecd-8fdd-75da245b6c5f -F qcow2" returned: 0 in 0.687s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:46 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Lock "cinder-quobyte-503a0b1b-12bb-4478-81c7-cd193875b72f" released by "_delete_snapshot" :: held 5.994s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:21:46 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Lock "cinder-quobyte-3b433099-f391-418c-92e9-35fff14bead7" released by "delete_snapshot" :: held 6.017s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:21:46 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Created reservations ['68de1f70-2d0f-4613-b3ad-e24080fd8708', '6f6f943d-6365-4df4-b30f-03fa493d7726', '5d027638-9592-4b35-ae0b-3f49b9b70867', 'ae4bcb66-2116-4c7a-ba28-70eaa6fec044'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:21:46 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Delete snapshot completed successfully. Apr 28 19:21:46 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Lock "cinder-503a0b1b-12bb-4478-81c7-cd193875b72f-delete_snapshot" released by "delete_snapshot" :: held 6.178s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:21:46 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Acquiring lock "cinder-fa7130c6-49d7-4ecd-8fdd-75da245b6c5f-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:21:46 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Lock "cinder-fa7130c6-49d7-4ecd-8fdd-75da245b6c5f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:21:46 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Acquiring lock "cinder-quobyte-3b433099-f391-418c-92e9-35fff14bead7" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:21:46 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Lock "cinder-quobyte-3b433099-f391-418c-92e9-35fff14bead7" acquired by "delete_snapshot" :: waited 0.025s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:21:46 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Acquiring lock "cinder-quobyte-fa7130c6-49d7-4ecd-8fdd-75da245b6c5f" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:21:46 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Lock "cinder-quobyte-fa7130c6-49d7-4ecd-8fdd-75da245b6c5f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:21:46 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Deleting offline snapshot fa7130c6-49d7-4ecd-8fdd-75da245b6c5f of volume 3b433099-f391-418c-92e9-35fff14bead7 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 19:21:46 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] snapshot_file for this snap is: volume-3b433099-f391-418c-92e9-35fff14bead7.fa7130c6-49d7-4ecd-8fdd-75da245b6c5f {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 19:21:46 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9e1aea-0818-47d4-8bea-f3ccc5e6711a]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:21:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.fa7130c6-49d7-4ecd-8fdd-75da245b6c5f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:46 devstack sudo[90840]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-59ac3e9d-877d-4ac0-97ba-d47facf2c480 tempest-GroupSnapshotsTest-2116439637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3bcf7f46-5c26-40e2-a896-ea473239ad73.info" returned: 0 in 0.725s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-59ac3e9d-877d-4ac0-97ba-d47facf2c480 tempest-GroupSnapshotsTest-2116439637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.441s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:21:46 devstack sudo[90857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.fa7130c6-49d7-4ecd-8fdd-75da245b6c5f Apr 28 19:21:46 devstack sudo[90857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:46 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-59ac3e9d-877d-4ac0-97ba-d47facf2c480 tempest-GroupSnapshotsTest-2116439637 None] group_snapshot af660ad3-c062-4d77-9985-d06015834b57: created successfully Apr 28 19:21:46 devstack sudo[90854]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cb8f8d32-9601-4d55-8d9d-f9868aa20ca3 tempest-VolumesGetTest-711720961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-86523126-1505-449c-b266-78be2d33609f" returned: 0 in 0.637s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:46 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cb8f8d32-9601-4d55-8d9d-f9868aa20ca3 tempest-VolumesGetTest-711720961 None] Lock "cinder-quobyte-86523126-1505-449c-b266-78be2d33609f" released by "delete_volume" :: held 1.441s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:21:46 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-cb8f8d32-9601-4d55-8d9d-f9868aa20ca3 tempest-VolumesGetTest-711720961 None] Created reservations ['54d601b6-6630-4bc7-897f-aa42789f9572', 'eb87907f-5092-4cc5-a574-66757e49ece4', 'c8b44410-1e95-4741-bfc5-4a7944d7d980', '131673c5-db75-4872-a9c2-1dd845db1538'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:21:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-cb8f8d32-9601-4d55-8d9d-f9868aa20ca3 tempest-VolumesGetTest-711720961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:21:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-cb8f8d32-9601-4d55-8d9d-f9868aa20ca3 tempest-VolumesGetTest-711720961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:21:46 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-cb8f8d32-9601-4d55-8d9d-f9868aa20ca3 tempest-VolumesGetTest-711720961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:21:46 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-cb8f8d32-9601-4d55-8d9d-f9868aa20ca3 tempest-VolumesGetTest-711720961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:21:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-cb8f8d32-9601-4d55-8d9d-f9868aa20ca3 tempest-VolumesGetTest-711720961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:21:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cb8f8d32-9601-4d55-8d9d-f9868aa20ca3 tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:46 devstack sudo[90860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:21:46 devstack sudo[90860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:47 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-cfe64a41-b0eb-4d41-89e6-7fb04fd0106c tempest-GroupSnapshotsTest-2116439637 None] group_snapshot af660ad3-c062-4d77-9985-d06015834b57: deleting Apr 28 19:21:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-cfe64a41-b0eb-4d41-89e6-7fb04fd0106c tempest-GroupSnapshotsTest-2116439637 None] group_snapshot af660ad3-c062-4d77-9985-d06015834b57: deleting {{(pid=83863) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 28 19:21:47 devstack sudo[90857]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.fa7130c6-49d7-4ecd-8fdd-75da245b6c5f" returned: 0 in 0.755s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:47 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b433099-f391-418c-92e9-35fff14bead7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:21:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cfe64a41-b0eb-4d41-89e6-7fb04fd0106c tempest-GroupSnapshotsTest-2116439637 None] Acquiring lock "cinder-quobyte-3bcf7f46-5c26-40e2-a896-ea473239ad73" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:21:47 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b928c6cf-c485-4069-84b4-6e9adb59701d]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:21:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cfe64a41-b0eb-4d41-89e6-7fb04fd0106c tempest-GroupSnapshotsTest-2116439637 None] Lock "cinder-quobyte-3bcf7f46-5c26-40e2-a896-ea473239ad73" acquired by "delete_snapshot" :: waited 0.032s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:21:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cfe64a41-b0eb-4d41-89e6-7fb04fd0106c tempest-GroupSnapshotsTest-2116439637 None] Acquiring lock "cinder-quobyte-7b12bdb2-d701-4d66-8d84-9ba23ab2f840" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:21:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cfe64a41-b0eb-4d41-89e6-7fb04fd0106c tempest-GroupSnapshotsTest-2116439637 None] Lock "cinder-quobyte-7b12bdb2-d701-4d66-8d84-9ba23ab2f840" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:21:47 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-cfe64a41-b0eb-4d41-89e6-7fb04fd0106c tempest-GroupSnapshotsTest-2116439637 None] Deleting offline snapshot 7b12bdb2-d701-4d66-8d84-9ba23ab2f840 of volume 3bcf7f46-5c26-40e2-a896-ea473239ad73 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 19:21:47 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-cfe64a41-b0eb-4d41-89e6-7fb04fd0106c tempest-GroupSnapshotsTest-2116439637 None] snapshot_file for this snap is: volume-3bcf7f46-5c26-40e2-a896-ea473239ad73.7b12bdb2-d701-4d66-8d84-9ba23ab2f840 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 19:21:47 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c5ebda-7a64-47c8-b285-512a023f5dd0]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:21:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cfe64a41-b0eb-4d41-89e6-7fb04fd0106c tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3bcf7f46-5c26-40e2-a896-ea473239ad73.7b12bdb2-d701-4d66-8d84-9ba23ab2f840 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:47 devstack sudo[90866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7 Apr 28 19:21:47 devstack sudo[90866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:47 devstack sudo[90867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3bcf7f46-5c26-40e2-a896-ea473239ad73.7b12bdb2-d701-4d66-8d84-9ba23ab2f840 Apr 28 19:21:47 devstack sudo[90867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:47 devstack sudo[90860]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cb8f8d32-9601-4d55-8d9d-f9868aa20ca3 tempest-VolumesGetTest-711720961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.647s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:47 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-cb8f8d32-9601-4d55-8d9d-f9868aa20ca3 tempest-VolumesGetTest-711720961 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:21:47 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-cb8f8d32-9601-4d55-8d9d-f9868aa20ca3 tempest-VolumesGetTest-711720961 None] Deleted volume successfully. Apr 28 19:21:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2b5a7f12-b5f3-467c-8b44-9962ec887ed2 tempest-VolumesGetTest-711720961 None] Acquiring lock "cinder-01a2bf25-4ee1-4407-8151-a98f3d0a27e6-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:21:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cb8f8d32-9601-4d55-8d9d-f9868aa20ca3 tempest-VolumesGetTest-711720961 None] Lock "cinder-86523126-1505-449c-b266-78be2d33609f-delete_volume" released by "delete_volume" :: held 2.359s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:21:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2b5a7f12-b5f3-467c-8b44-9962ec887ed2 tempest-VolumesGetTest-711720961 None] Lock "cinder-01a2bf25-4ee1-4407-8151-a98f3d0a27e6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:21:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2b5a7f12-b5f3-467c-8b44-9962ec887ed2 tempest-VolumesGetTest-711720961 None] Acquiring lock "cinder-quobyte-01a2bf25-4ee1-4407-8151-a98f3d0a27e6" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:21:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2b5a7f12-b5f3-467c-8b44-9962ec887ed2 tempest-VolumesGetTest-711720961 None] Lock "cinder-quobyte-01a2bf25-4ee1-4407-8151-a98f3d0a27e6" acquired by "delete_volume" :: waited 0.014s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:21:47 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[438ae889-b962-4e71-a680-d147552a17d1]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:21:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2b5a7f12-b5f3-467c-8b44-9962ec887ed2 tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:47 devstack sudo[90871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6 Apr 28 19:21:47 devstack sudo[90871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:48 devstack sudo[90866]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7" returned: 0 in 0.881s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.fa7130c6-49d7-4ecd-8fdd-75da245b6c5f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:48 devstack sudo[90867]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cfe64a41-b0eb-4d41-89e6-7fb04fd0106c tempest-GroupSnapshotsTest-2116439637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3bcf7f46-5c26-40e2-a896-ea473239ad73.7b12bdb2-d701-4d66-8d84-9ba23ab2f840" returned: 0 in 0.806s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:48 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-cfe64a41-b0eb-4d41-89e6-7fb04fd0106c tempest-GroupSnapshotsTest-2116439637 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3bcf7f46-5c26-40e2-a896-ea473239ad73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:21:48 devstack sudo[90880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.fa7130c6-49d7-4ecd-8fdd-75da245b6c5f Apr 28 19:21:48 devstack sudo[90880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:48 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b62886-01fb-4ca6-b11f-a333456f2f11]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:21:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cfe64a41-b0eb-4d41-89e6-7fb04fd0106c tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3bcf7f46-5c26-40e2-a896-ea473239ad73 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:48 devstack sudo[90883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3bcf7f46-5c26-40e2-a896-ea473239ad73 Apr 28 19:21:48 devstack sudo[90883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:48 devstack sudo[90871]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2b5a7f12-b5f3-467c-8b44-9962ec887ed2 tempest-VolumesGetTest-711720961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6" returned: 0 in 0.720s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2b5a7f12-b5f3-467c-8b44-9962ec887ed2 tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:48 devstack sudo[90888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6 Apr 28 19:21:48 devstack sudo[90888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:48 devstack sudo[90880]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.fa7130c6-49d7-4ecd-8fdd-75da245b6c5f" returned: 0 in 0.717s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.fa7130c6-49d7-4ecd-8fdd-75da245b6c5f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:48 devstack sudo[90896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.fa7130c6-49d7-4ecd-8fdd-75da245b6c5f Apr 28 19:21:48 devstack sudo[90896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:48 devstack sudo[90883]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cfe64a41-b0eb-4d41-89e6-7fb04fd0106c tempest-GroupSnapshotsTest-2116439637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3bcf7f46-5c26-40e2-a896-ea473239ad73" returned: 0 in 0.777s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cfe64a41-b0eb-4d41-89e6-7fb04fd0106c tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3bcf7f46-5c26-40e2-a896-ea473239ad73.7b12bdb2-d701-4d66-8d84-9ba23ab2f840 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:48 devstack sudo[90898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3bcf7f46-5c26-40e2-a896-ea473239ad73.7b12bdb2-d701-4d66-8d84-9ba23ab2f840 Apr 28 19:21:48 devstack sudo[90898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:49 devstack sudo[90888]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2b5a7f12-b5f3-467c-8b44-9962ec887ed2 tempest-VolumesGetTest-711720961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-01a2bf25-4ee1-4407-8151-a98f3d0a27e6" returned: 0 in 0.664s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:49 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2b5a7f12-b5f3-467c-8b44-9962ec887ed2 tempest-VolumesGetTest-711720961 None] Lock "cinder-quobyte-01a2bf25-4ee1-4407-8151-a98f3d0a27e6" released by "delete_volume" :: held 1.447s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:21:49 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:UPDATE=139,cinder:SELECT=129,cinder:DELETE=6,cinder:INSERT=31 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 19:21:49 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:SELECT=120,cinder:UPDATE=145,cinder:INSERT=35,cinder:DELETE=14 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 19:21:49 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-2b5a7f12-b5f3-467c-8b44-9962ec887ed2 tempest-VolumesGetTest-711720961 None] Created reservations ['f0788c70-1a6b-4e77-831b-cf94de8e3aa9', '2c0751e3-c308-4813-8146-8d42c396464b', '02469e27-53dc-488f-b3e4-fa8bdc21f0c6', '61b41046-3471-46c0-abf4-4c66cddd2b1c'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:21:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2b5a7f12-b5f3-467c-8b44-9962ec887ed2 tempest-VolumesGetTest-711720961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:21:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2b5a7f12-b5f3-467c-8b44-9962ec887ed2 tempest-VolumesGetTest-711720961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:21:49 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2b5a7f12-b5f3-467c-8b44-9962ec887ed2 tempest-VolumesGetTest-711720961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:21:49 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2b5a7f12-b5f3-467c-8b44-9962ec887ed2 tempest-VolumesGetTest-711720961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:21:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2b5a7f12-b5f3-467c-8b44-9962ec887ed2 tempest-VolumesGetTest-711720961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:21:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2b5a7f12-b5f3-467c-8b44-9962ec887ed2 tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:49 devstack sudo[90901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:21:49 devstack sudo[90901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:49 devstack sudo[90896]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7.fa7130c6-49d7-4ecd-8fdd-75da245b6c5f" returned: 0 in 0.640s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:49 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Lock "cinder-quobyte-fa7130c6-49d7-4ecd-8fdd-75da245b6c5f" released by "_delete_snapshot" :: held 3.109s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:21:49 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Lock "cinder-quobyte-3b433099-f391-418c-92e9-35fff14bead7" released by "delete_snapshot" :: held 3.139s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:21:49 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Created reservations ['d1a20d96-16c7-4f34-872c-8a3f8e9a2c92', '6ef86ebb-02d9-450a-8704-ec3e5b2c064a', '8ef8a12a-c1b5-454d-905a-bfff8e8ce746', 'b7292fa5-ac50-4b69-9302-fc8f44c92752'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:21:49 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Delete snapshot completed successfully. Apr 28 19:21:49 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Lock "cinder-fa7130c6-49d7-4ecd-8fdd-75da245b6c5f-delete_snapshot" released by "delete_snapshot" :: held 3.306s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:21:49 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Snapshots deleted, issuing volume delete {{(pid=83863) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 28 19:21:49 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Acquiring lock "cinder-quobyte-3b433099-f391-418c-92e9-35fff14bead7" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:21:49 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Lock "cinder-quobyte-3b433099-f391-418c-92e9-35fff14bead7" acquired by "delete_volume" :: waited 0.016s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:21:49 devstack sudo[90898]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cfe64a41-b0eb-4d41-89e6-7fb04fd0106c tempest-GroupSnapshotsTest-2116439637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3bcf7f46-5c26-40e2-a896-ea473239ad73.7b12bdb2-d701-4d66-8d84-9ba23ab2f840" returned: 0 in 0.770s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cfe64a41-b0eb-4d41-89e6-7fb04fd0106c tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3bcf7f46-5c26-40e2-a896-ea473239ad73.7b12bdb2-d701-4d66-8d84-9ba23ab2f840 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:49 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[400b559b-68b9-4f44-a1eb-831e62ba4400]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:21:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:49 devstack sudo[90908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3bcf7f46-5c26-40e2-a896-ea473239ad73.7b12bdb2-d701-4d66-8d84-9ba23ab2f840 Apr 28 19:21:49 devstack sudo[90908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:49 devstack sudo[90909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7 Apr 28 19:21:49 devstack sudo[90909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:49 devstack sudo[90901]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2b5a7f12-b5f3-467c-8b44-9962ec887ed2 tempest-VolumesGetTest-711720961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.694s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:49 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-2b5a7f12-b5f3-467c-8b44-9962ec887ed2 tempest-VolumesGetTest-711720961 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:21:49 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-2b5a7f12-b5f3-467c-8b44-9962ec887ed2 tempest-VolumesGetTest-711720961 None] Deleted volume successfully. Apr 28 19:21:49 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2b5a7f12-b5f3-467c-8b44-9962ec887ed2 tempest-VolumesGetTest-711720961 None] Lock "cinder-01a2bf25-4ee1-4407-8151-a98f3d0a27e6-delete_volume" released by "delete_volume" :: held 2.368s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:21:50 devstack sudo[90908]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cfe64a41-b0eb-4d41-89e6-7fb04fd0106c tempest-GroupSnapshotsTest-2116439637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3bcf7f46-5c26-40e2-a896-ea473239ad73.7b12bdb2-d701-4d66-8d84-9ba23ab2f840" returned: 0 in 0.720s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:50 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cfe64a41-b0eb-4d41-89e6-7fb04fd0106c tempest-GroupSnapshotsTest-2116439637 None] Lock "cinder-quobyte-7b12bdb2-d701-4d66-8d84-9ba23ab2f840" released by "_delete_snapshot" :: held 3.190s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:21:50 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cfe64a41-b0eb-4d41-89e6-7fb04fd0106c tempest-GroupSnapshotsTest-2116439637 None] Lock "cinder-quobyte-3bcf7f46-5c26-40e2-a896-ea473239ad73" released by "delete_snapshot" :: held 3.219s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:21:50 devstack sudo[90909]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7" returned: 0 in 0.820s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:50 devstack sudo[90917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7 Apr 28 19:21:50 devstack sudo[90917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:50 devstack cinder-volume[83863]: WARNING cinder.quota [None req-cfe64a41-b0eb-4d41-89e6-7fb04fd0106c tempest-GroupSnapshotsTest-2116439637 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1098519875 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1098519875, it is now deprecated. Please use the default quota class for default quota. Apr 28 19:21:50 devstack cinder-volume[83863]: WARNING cinder.quota [None req-cfe64a41-b0eb-4d41-89e6-7fb04fd0106c tempest-GroupSnapshotsTest-2116439637 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1098519875 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1098519875, it is now deprecated. Please use the default quota class for default quota. Apr 28 19:21:50 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:21:50 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Flow 'volume_create_manager' (2aa572e5-efaf-465d-bd3b-fcfc360d63fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:21:50 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (592e0b90-d213-4080-96eb-e40044ee2689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:50 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-cfe64a41-b0eb-4d41-89e6-7fb04fd0106c tempest-GroupSnapshotsTest-2116439637 None] Created reservations ['1bdb7e85-a705-4997-a777-0b7629f1a3e0', 'c9ed7201-ee17-4795-8ad2-4c3ab97df1af', 'd5a17c46-fc88-4f60-90c0-f61e9df49dd9', '3edbd9fe-01b0-46df-a611-845d4f209e88'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:21:50 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (592e0b90-d213-4080-96eb-e40044ee2689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-256410771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=994f92e4-4d5d-4b36-84c8-c45dd89d7de4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9b8969a99ceb4c87b83e42ed49dfe036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:21:51Z,use_quota=True,user_id='49def545e71141ef8b767db7c433c4f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:50 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7b00a18-53e2-4089-bb4c-9f9d49206cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:50 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7b00a18-53e2-4089-bb4c-9f9d49206cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:50 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc9204e7-1a8c-4ef4-9d07-320790bb0610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:50 devstack cinder-volume[83863]: DEBUG cinder.image.glance [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Creating Keystone auth plugin from conf {{(pid=83863) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 28 19:21:50 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-cfe64a41-b0eb-4d41-89e6-7fb04fd0106c tempest-GroupSnapshotsTest-2116439637 None] group_snapshot af660ad3-c062-4d77-9985-d06015834b57: deleted successfully Apr 28 19:21:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc9204e7-1a8c-4ef4-9d07-320790bb0610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '994f92e4-4d5d-4b36-84c8-c45dd89d7de4', 'volume_name': 'volume-994f92e4-4d5d-4b36-84c8-c45dd89d7de4', 'volume_size': 1, 'image_id': 'd11adb91-6b52-452f-a796-9ef8412183bf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d11adb91-6b52-452f-a796-9ef8412183bf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6469daf89505401a8582e1f501a60d80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd11adb91-6b52-452f-a796-9ef8412183bf', 'created_at': datetime.datetime(2026, 4, 28, 17, 9, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 17, 9, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d11adb91-6b52-452f-a796-9ef8412183bf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beb99477-addd-4423-b3a6-540824dcbe71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beb99477-addd-4423-b3a6-540824dcbe71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (765f2306-5edc-442a-aa6c-5e4e7827b91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:51 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Volume 994f92e4-4d5d-4b36-84c8-c45dd89d7de4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-994f92e4-4d5d-4b36-84c8-c45dd89d7de4', 'volume_size': 1, 'image_id': 'd11adb91-6b52-452f-a796-9ef8412183bf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d11adb91-6b52-452f-a796-9ef8412183bf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6469daf89505401a8582e1f501a60d80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd11adb91-6b52-452f-a796-9ef8412183bf', 'created_at': datetime.datetime(2026, 4, 28, 17, 9, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 17, 9, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d11adb91-6b52-452f-a796-9ef8412183bf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 28 19:21:51 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Trying to clone 994f92e4-4d5d-4b36-84c8-c45dd89d7de4 from image d11adb91-6b52-452f-a796-9ef8412183bf at location (None, [{'url': 'file:///opt/stack/data/glance/images/d11adb91-6b52-452f-a796-9ef8412183bf', 'metadata': {}}]). {{(pid=83863) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Apr 28 19:21:51 devstack sudo[90917]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3b433099-f391-418c-92e9-35fff14bead7" returned: 0 in 0.630s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:51 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Lock "cinder-quobyte-3b433099-f391-418c-92e9-35fff14bead7" released by "delete_volume" :: held 1.541s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:21:51 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Created reservations ['a8d2cdaf-e376-46c9-b17e-226cfbdf0d04', 'd2a7b1e1-bb21-41c2-a514-db23263eda0f', 'c05f41d2-bc8a-485f-990a-21c29e342423', '71ec64b2-0b4f-4fb7-affd-bf0a259bd80e'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:21:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:21:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:21:51 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:21:51 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:21:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:21:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:51 devstack sudo[90923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:21:51 devstack sudo[90923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:51 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_n3luku8_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83863) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 28 19:21:51 devstack cinder-volume[83863]: INFO cinder.image.image_utils [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Image download 20.69 MB at 20.69 MB/s Apr 28 19:21:51 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d4bd5e-efbf-461a-851f-82c010a24a6f]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:21:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_n3luku8_devstack@QuobyteHD {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:51 devstack sudo[90926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_n3luku8_devstack@QuobyteHD Apr 28 19:21:51 devstack sudo[90926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:51 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e357971b-6301-49c2-a49e-cfa3e0df3186 tempest-GroupSnapshotsTest-2116439637 None] Acquiring lock "cinder-quobyte-3bcf7f46-5c26-40e2-a896-ea473239ad73" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:21:51 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e357971b-6301-49c2-a49e-cfa3e0df3186 tempest-GroupSnapshotsTest-2116439637 None] Lock "cinder-quobyte-3bcf7f46-5c26-40e2-a896-ea473239ad73" acquired by "delete_volume" :: waited 0.020s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:21:51 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dfd2e64-5488-4cbc-9d06-ba478fa90208]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:21:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e357971b-6301-49c2-a49e-cfa3e0df3186 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3bcf7f46-5c26-40e2-a896-ea473239ad73 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:51 devstack sudo[90928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3bcf7f46-5c26-40e2-a896-ea473239ad73 Apr 28 19:21:51 devstack sudo[90928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:52 devstack sudo[90923]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.752s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:52 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:21:52 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Deleted volume successfully. Apr 28 19:21:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e9cf694b-12a4-46f2-bdc9-01144807b036 tempest-VolumesDeleteCascade-1370866783 None] Lock "cinder-3b433099-f391-418c-92e9-35fff14bead7-delete_volume" released by "delete_volume" :: held 12.120s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:21:52 devstack sudo[90926]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_n3luku8_devstack@QuobyteHD" returned: 0 in 0.776s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:52 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Temporary image d11adb91-6b52-452f-a796-9ef8412183bf is fetched for user 49def545e71141ef8b767db7c433c4f4. {{(pid=83863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 28 19:21:52 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b382f77b-0da3-4bed-a881-df2f09e3063b]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:21:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_n3luku8_devstack@QuobyteHD {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:52 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5ba7bb3-c5a4-4514-8726-10b2d5a1b6a9 tempest-VolumesDeleteCascade-1370866783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:21:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5ba7bb3-c5a4-4514-8726-10b2d5a1b6a9 tempest-VolumesDeleteCascade-1370866783 None] Flow 'volume_create_manager' (44eba6e4-a3e4-4a26-8b02-8d19e023fa0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:21:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5ba7bb3-c5a4-4514-8726-10b2d5a1b6a9 tempest-VolumesDeleteCascade-1370866783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (437653c5-9126-4732-a43b-dd7792c2300e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5ba7bb3-c5a4-4514-8726-10b2d5a1b6a9 tempest-VolumesDeleteCascade-1370866783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (437653c5-9126-4732-a43b-dd7792c2300e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1220016256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c4bb39c-1d6c-4e99-acc9-6a2259570e4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c74bec58de48a0a09954d83a282ce7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:21:52Z,use_quota=True,user_id='fb5ff5edc6b244418fca76edd1bb9826',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5ba7bb3-c5a4-4514-8726-10b2d5a1b6a9 tempest-VolumesDeleteCascade-1370866783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42e42eeb-4211-4685-949e-12bdb4aa4b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5ba7bb3-c5a4-4514-8726-10b2d5a1b6a9 tempest-VolumesDeleteCascade-1370866783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42e42eeb-4211-4685-949e-12bdb4aa4b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:52 devstack sudo[90934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_n3luku8_devstack@QuobyteHD Apr 28 19:21:52 devstack sudo[90934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5ba7bb3-c5a4-4514-8726-10b2d5a1b6a9 tempest-VolumesDeleteCascade-1370866783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2edd3351-a716-4afb-9481-976d239987db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5ba7bb3-c5a4-4514-8726-10b2d5a1b6a9 tempest-VolumesDeleteCascade-1370866783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2edd3351-a716-4afb-9481-976d239987db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c4bb39c-1d6c-4e99-acc9-6a2259570e4e', 'volume_name': 'volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5ba7bb3-c5a4-4514-8726-10b2d5a1b6a9 tempest-VolumesDeleteCascade-1370866783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38c1010c-9989-4322-a759-66df79018115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5ba7bb3-c5a4-4514-8726-10b2d5a1b6a9 tempest-VolumesDeleteCascade-1370866783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38c1010c-9989-4322-a759-66df79018115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5ba7bb3-c5a4-4514-8726-10b2d5a1b6a9 tempest-VolumesDeleteCascade-1370866783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1dc3c8e-35cb-45bd-bb45-011736357eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:52 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-a5ba7bb3-c5a4-4514-8726-10b2d5a1b6a9 tempest-VolumesDeleteCascade-1370866783 None] Volume 4c4bb39c-1d6c-4e99-acc9-6a2259570e4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e', 'volume_size': 1} Apr 28 19:21:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a5ba7bb3-c5a4-4514-8726-10b2d5a1b6a9 tempest-VolumesDeleteCascade-1370866783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:21:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a5ba7bb3-c5a4-4514-8726-10b2d5a1b6a9 tempest-VolumesDeleteCascade-1370866783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:21:52 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a5ba7bb3-c5a4-4514-8726-10b2d5a1b6a9 tempest-VolumesDeleteCascade-1370866783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1220016256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c4bb39c-1d6c-4e99-acc9-6a2259570e4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c74bec58de48a0a09954d83a282ce7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:21:52Z,use_quota=True,user_id='fb5ff5edc6b244418fca76edd1bb9826',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:21:52 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-a5ba7bb3-c5a4-4514-8726-10b2d5a1b6a9 tempest-VolumesDeleteCascade-1370866783 None] Creating volume 4c4bb39c-1d6c-4e99-acc9-6a2259570e4e {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:21:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a5ba7bb3-c5a4-4514-8726-10b2d5a1b6a9 tempest-VolumesDeleteCascade-1370866783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:21:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a5ba7bb3-c5a4-4514-8726-10b2d5a1b6a9 tempest-VolumesDeleteCascade-1370866783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:21:52 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a5ba7bb3-c5a4-4514-8726-10b2d5a1b6a9 tempest-VolumesDeleteCascade-1370866783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:21:52 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a5ba7bb3-c5a4-4514-8726-10b2d5a1b6a9 tempest-VolumesDeleteCascade-1370866783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:21:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a5ba7bb3-c5a4-4514-8726-10b2d5a1b6a9 tempest-VolumesDeleteCascade-1370866783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:21:52 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a5ba7bb3-c5a4-4514-8726-10b2d5a1b6a9 tempest-VolumesDeleteCascade-1370866783 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:21:52 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-a5ba7bb3-c5a4-4514-8726-10b2d5a1b6a9 tempest-VolumesDeleteCascade-1370866783 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:21:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a5ba7bb3-c5a4-4514-8726-10b2d5a1b6a9 tempest-VolumesDeleteCascade-1370866783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:52 devstack sudo[90940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e 1073741824 Apr 28 19:21:52 devstack sudo[90940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:52 devstack sudo[90928]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e357971b-6301-49c2-a49e-cfa3e0df3186 tempest-GroupSnapshotsTest-2116439637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3bcf7f46-5c26-40e2-a896-ea473239ad73" returned: 0 in 0.847s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e357971b-6301-49c2-a49e-cfa3e0df3186 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3bcf7f46-5c26-40e2-a896-ea473239ad73 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:52 devstack sudo[90942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3bcf7f46-5c26-40e2-a896-ea473239ad73 Apr 28 19:21:52 devstack sudo[90942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:53 devstack sudo[90934]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_n3luku8_devstack@QuobyteHD" returned: 0 in 0.748s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:21:53 devstack sudo[90942]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e357971b-6301-49c2-a49e-cfa3e0df3186 tempest-GroupSnapshotsTest-2116439637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3bcf7f46-5c26-40e2-a896-ea473239ad73" returned: 0 in 0.619s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:53 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e357971b-6301-49c2-a49e-cfa3e0df3186 tempest-GroupSnapshotsTest-2116439637 None] Lock "cinder-quobyte-3bcf7f46-5c26-40e2-a896-ea473239ad73" released by "delete_volume" :: held 1.561s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:21:53 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-e357971b-6301-49c2-a49e-cfa3e0df3186 tempest-GroupSnapshotsTest-2116439637 None] Created reservations ['c0f13586-2c4d-448b-8cbb-30f656be160c'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:21:53 devstack sudo[90940]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a5ba7bb3-c5a4-4514-8726-10b2d5a1b6a9 tempest-VolumesDeleteCascade-1370866783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e 1073741824" returned: 0 in 0.819s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:53 devstack cinder-volume[83863]: WARNING cinder.quota [None req-e357971b-6301-49c2-a49e-cfa3e0df3186 tempest-GroupSnapshotsTest-2116439637 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1098519875 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1098519875, it is now deprecated. Please use the default quota class for default quota. Apr 28 19:21:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a5ba7bb3-c5a4-4514-8726-10b2d5a1b6a9 tempest-VolumesDeleteCascade-1370866783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:53 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-e357971b-6301-49c2-a49e-cfa3e0df3186 tempest-GroupSnapshotsTest-2116439637 None] Created reservations ['fcae9da7-caf5-42ba-880b-3b1d27e0febe', '60812630-ee74-4a2e-a6da-369a4c26c146', '6f0353ee-ae7b-4f53-b6c9-c162df31f799', 'bb7b1a57-5ba0-4df6-a3dd-17373f6d52e9'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:21:53 devstack sudo[90951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e Apr 28 19:21:53 devstack sudo[90951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e357971b-6301-49c2-a49e-cfa3e0df3186 tempest-GroupSnapshotsTest-2116439637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:21:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e357971b-6301-49c2-a49e-cfa3e0df3186 tempest-GroupSnapshotsTest-2116439637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:21:53 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-e357971b-6301-49c2-a49e-cfa3e0df3186 tempest-GroupSnapshotsTest-2116439637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:21:53 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-e357971b-6301-49c2-a49e-cfa3e0df3186 tempest-GroupSnapshotsTest-2116439637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:21:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e357971b-6301-49c2-a49e-cfa3e0df3186 tempest-GroupSnapshotsTest-2116439637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:21:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e357971b-6301-49c2-a49e-cfa3e0df3186 tempest-GroupSnapshotsTest-2116439637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:53 devstack sudo[90953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:21:53 devstack sudo[90953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:54 devstack sudo[90951]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a5ba7bb3-c5a4-4514-8726-10b2d5a1b6a9 tempest-VolumesDeleteCascade-1370866783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e" returned: 0 in 0.626s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:54 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a5ba7bb3-c5a4-4514-8726-10b2d5a1b6a9 tempest-VolumesDeleteCascade-1370866783 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:21:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a5ba7bb3-c5a4-4514-8726-10b2d5a1b6a9 tempest-VolumesDeleteCascade-1370866783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:21:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.895s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:21:54 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-256410771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=994f92e4-4d5d-4b36-84c8-c45dd89d7de4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9b8969a99ceb4c87b83e42ed49dfe036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:21:51Z,use_quota=True,user_id='49def545e71141ef8b767db7c433c4f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:21:54 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Creating volume 994f92e4-4d5d-4b36-84c8-c45dd89d7de4 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:21:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:21:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:21:54 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:21:54 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:21:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:21:54 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:21:54 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:21:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-994f92e4-4d5d-4b36-84c8-c45dd89d7de4 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:54 devstack sudo[90956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-994f92e4-4d5d-4b36-84c8-c45dd89d7de4 1073741824 Apr 28 19:21:54 devstack sudo[90956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:54 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5ba7bb3-c5a4-4514-8726-10b2d5a1b6a9 tempest-VolumesDeleteCascade-1370866783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1dc3c8e-35cb-45bd-bb45-011736357eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:54 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5ba7bb3-c5a4-4514-8726-10b2d5a1b6a9 tempest-VolumesDeleteCascade-1370866783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85cadfe0-9669-4b32-bb7d-66b5ef4d358a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:21:54 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-a5ba7bb3-c5a4-4514-8726-10b2d5a1b6a9 tempest-VolumesDeleteCascade-1370866783 None] Volume volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e (4c4bb39c-1d6c-4e99-acc9-6a2259570e4e): created successfully Apr 28 19:21:54 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5ba7bb3-c5a4-4514-8726-10b2d5a1b6a9 tempest-VolumesDeleteCascade-1370866783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85cadfe0-9669-4b32-bb7d-66b5ef4d358a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:21:54 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5ba7bb3-c5a4-4514-8726-10b2d5a1b6a9 tempest-VolumesDeleteCascade-1370866783 None] Flow 'volume_create_manager' (44eba6e4-a3e4-4a26-8b02-8d19e023fa0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:21:54 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-a5ba7bb3-c5a4-4514-8726-10b2d5a1b6a9 tempest-VolumesDeleteCascade-1370866783 None] Created volume successfully. Apr 28 19:21:54 devstack sudo[90953]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e357971b-6301-49c2-a49e-cfa3e0df3186 tempest-GroupSnapshotsTest-2116439637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.664s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:54 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-e357971b-6301-49c2-a49e-cfa3e0df3186 tempest-GroupSnapshotsTest-2116439637 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:21:54 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-e357971b-6301-49c2-a49e-cfa3e0df3186 tempest-GroupSnapshotsTest-2116439637 None] Delete group completed successfully. Apr 28 19:21:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4153f097-d798-45cc-a37c-f5789235d031 tempest-VolumesDeleteCascade-1370866783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:21:54 devstack sudo[90956]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-994f92e4-4d5d-4b36-84c8-c45dd89d7de4 1073741824" returned: 0 in 0.879s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-994f92e4-4d5d-4b36-84c8-c45dd89d7de4 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:55 devstack sudo[90963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-994f92e4-4d5d-4b36-84c8-c45dd89d7de4 Apr 28 19:21:55 devstack sudo[90963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:55 devstack sudo[90963]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-994f92e4-4d5d-4b36-84c8-c45dd89d7de4" returned: 0 in 0.625s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:55 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] <== create_volume: return (1549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:21:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.552s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:21:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4153f097-d798-45cc-a37c-f5789235d031 tempest-VolumesDeleteCascade-1370866783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.807s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:21:55 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-4153f097-d798-45cc-a37c-f5789235d031 tempest-VolumesDeleteCascade-1370866783 None] Creating offline snapshot 53e28a72-bb8e-4fdc-8d66-68e1edb69875 of volume 4c4bb39c-1d6c-4e99-acc9-6a2259570e4e {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 19:21:55 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81e02c8-7297-48de-8d46-b38b2067a054]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:21:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4153f097-d798-45cc-a37c-f5789235d031 tempest-VolumesDeleteCascade-1370866783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:55 devstack cinder-volume[83863]: DEBUG cinder.volume.volume_utils [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Attempting download of d11adb91-6b52-452f-a796-9ef8412183bf ((None, [{'url': 'file:///opt/stack/data/glance/images/d11adb91-6b52-452f-a796-9ef8412183bf', 'metadata': {}}])) to volume 994f92e4-4d5d-4b36-84c8-c45dd89d7de4. {{(pid=83863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 28 19:21:55 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52b9521-0e76-4ce8-84ae-146c9a966ccc]: (4, 'raw') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:21:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d11adb91-6b52-452f-a796-9ef8412183bf_plivpwf7 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:55 devstack sudo[90967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e Apr 28 19:21:55 devstack sudo[90967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:55 devstack sudo[90968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d11adb91-6b52-452f-a796-9ef8412183bf_plivpwf7 Apr 28 19:21:55 devstack sudo[90968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:56 devstack sudo[90968]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d11adb91-6b52-452f-a796-9ef8412183bf_plivpwf7" returned: 0 in 0.717s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d11adb91-6b52-452f-a796-9ef8412183bf_plivpwf7 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:56 devstack sudo[90967]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4153f097-d798-45cc-a37c-f5789235d031 tempest-VolumesDeleteCascade-1370866783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e" returned: 0 in 0.825s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4153f097-d798-45cc-a37c-f5789235d031 tempest-VolumesDeleteCascade-1370866783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e.53e28a72-bb8e-4fdc-8d66-68e1edb69875 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:56 devstack sudo[90977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e.53e28a72-bb8e-4fdc-8d66-68e1edb69875 1G Apr 28 19:21:56 devstack sudo[90977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:56 devstack sudo[90976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d11adb91-6b52-452f-a796-9ef8412183bf_plivpwf7 Apr 28 19:21:56 devstack sudo[90976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:57 devstack sudo[90976]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d11adb91-6b52-452f-a796-9ef8412183bf_plivpwf7" returned: 1 in 0.769s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d11adb91-6b52-452f-a796-9ef8412183bf_plivpwf7' failed. Not Retrying. {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 19:21:57 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91efa60-77e9-4417-9845-2e0b04da59c3]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:21:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_n3luku8_devstack@QuobyteHD {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:57 devstack sudo[90977]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4153f097-d798-45cc-a37c-f5789235d031 tempest-VolumesDeleteCascade-1370866783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e.53e28a72-bb8e-4fdc-8d66-68e1edb69875 1G" returned: 0 in 0.820s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4153f097-d798-45cc-a37c-f5789235d031 tempest-VolumesDeleteCascade-1370866783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e.53e28a72-bb8e-4fdc-8d66-68e1edb69875 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:57 devstack sudo[90988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e.53e28a72-bb8e-4fdc-8d66-68e1edb69875 Apr 28 19:21:57 devstack sudo[90988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:57 devstack sudo[90987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_n3luku8_devstack@QuobyteHD Apr 28 19:21:57 devstack sudo[90987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:57 devstack sudo[90987]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_n3luku8_devstack@QuobyteHD" returned: 0 in 0.720s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:57 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] d11adb91-6b52-452f-a796-9ef8412183bf was qcow2, converting to raw {{(pid=83863) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 28 19:21:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_n3luku8_devstack@QuobyteHD /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-994f92e4-4d5d-4b36-84c8-c45dd89d7de4 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:58 devstack sudo[90997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_n3luku8_devstack@QuobyteHD /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-994f92e4-4d5d-4b36-84c8-c45dd89d7de4 Apr 28 19:21:58 devstack sudo[90997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:58 devstack sudo[90988]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4153f097-d798-45cc-a37c-f5789235d031 tempest-VolumesDeleteCascade-1370866783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e.53e28a72-bb8e-4fdc-8d66-68e1edb69875" returned: 0 in 0.730s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:58 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-4153f097-d798-45cc-a37c-f5789235d031 tempest-VolumesDeleteCascade-1370866783 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e.53e28a72-bb8e-4fdc-8d66-68e1edb69875 is being set with open permissions: ugo+rw Apr 28 19:21:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4153f097-d798-45cc-a37c-f5789235d031 tempest-VolumesDeleteCascade-1370866783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e.53e28a72-bb8e-4fdc-8d66-68e1edb69875 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:58 devstack sudo[90999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e.53e28a72-bb8e-4fdc-8d66-68e1edb69875 Apr 28 19:21:58 devstack sudo[90999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:58 devstack sudo[90999]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4153f097-d798-45cc-a37c-f5789235d031 tempest-VolumesDeleteCascade-1370866783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e.53e28a72-bb8e-4fdc-8d66-68e1edb69875" returned: 0 in 0.597s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4153f097-d798-45cc-a37c-f5789235d031 tempest-VolumesDeleteCascade-1370866783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:58 devstack sudo[91010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e.info Apr 28 19:21:58 devstack sudo[91010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:59 devstack sudo[91010]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4153f097-d798-45cc-a37c-f5789235d031 tempest-VolumesDeleteCascade-1370866783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e.info" returned: 0 in 0.658s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:21:59 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-4153f097-d798-45cc-a37c-f5789235d031 tempest-VolumesDeleteCascade-1370866783 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e.info is being set with open permissions: ugo+rw Apr 28 19:21:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4153f097-d798-45cc-a37c-f5789235d031 tempest-VolumesDeleteCascade-1370866783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:21:59 devstack sudo[91013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e.info Apr 28 19:21:59 devstack sudo[91013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:21:59 devstack sudo[91013]: pam_unix(sudo:session): session closed for user root Apr 28 19:21:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4153f097-d798-45cc-a37c-f5789235d031 tempest-VolumesDeleteCascade-1370866783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e.info" returned: 0 in 0.656s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4153f097-d798-45cc-a37c-f5789235d031 tempest-VolumesDeleteCascade-1370866783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.390s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:22:00 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-4153f097-d798-45cc-a37c-f5789235d031 tempest-VolumesDeleteCascade-1370866783 None] Create snapshot completed successfully Apr 28 19:22:00 devstack sudo[90997]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_n3luku8_devstack@QuobyteHD /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-994f92e4-4d5d-4b36-84c8-c45dd89d7de4" returned: 0 in 2.110s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:00 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_n3luku8_devstack@QuobyteHD, size 112.00 MB, duration 2.11 sec, destination /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-994f92e4-4d5d-4b36-84c8-c45dd89d7de4 {{(pid=83863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 19:22:00 devstack cinder-volume[83863]: INFO cinder.image.image_utils [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Converted 112.00 MB image at 53.04 MB/s Apr 28 19:22:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-994f92e4-4d5d-4b36-84c8-c45dd89d7de4 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:00 devstack sudo[91016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-994f92e4-4d5d-4b36-84c8-c45dd89d7de4 1G Apr 28 19:22:00 devstack sudo[91016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:00 devstack sudo[91016]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-994f92e4-4d5d-4b36-84c8-c45dd89d7de4 1G" returned: 0 in 0.669s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:00 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[85785306-62ef-4035-92fb-d8e4ce7ea9c0]: (4, 'raw') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:22:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-994f92e4-4d5d-4b36-84c8-c45dd89d7de4 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:00 devstack sudo[91022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-994f92e4-4d5d-4b36-84c8-c45dd89d7de4 Apr 28 19:22:00 devstack sudo[91022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:01 devstack sudo[91022]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-994f92e4-4d5d-4b36-84c8-c45dd89d7de4" returned: 0 in 0.759s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-994f92e4-4d5d-4b36-84c8-c45dd89d7de4 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:01 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:22:01 devstack sudo[91026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-994f92e4-4d5d-4b36-84c8-c45dd89d7de4 Apr 28 19:22:01 devstack sudo[91026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] Flow 'volume_create_manager' (073a9f4c-5649-48ac-a154-6382cf62cf3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:22:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1f43e8b-4434-46ee-9e5d-a2595139a125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1f43e8b-4434-46ee-9e5d-a2595139a125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1386195947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99442fd1-817c-4bc2-a503-c6c0744b8b18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c74bec58de48a0a09954d83a282ce7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=53e28a72-bb8e-4fdc-8d66-68e1edb69875,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:22:02Z,use_quota=True,user_id='fb5ff5edc6b244418fca76edd1bb9826',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59b4ebec-4cc3-430b-96c6-0211b31b7a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59b4ebec-4cc3-430b-96c6-0211b31b7a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e59fa2c-6cae-487d-bc5c-b7e077808a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e59fa2c-6cae-487d-bc5c-b7e077808a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '99442fd1-817c-4bc2-a503-c6c0744b8b18', 'volume_name': 'volume-99442fd1-817c-4bc2-a503-c6c0744b8b18', 'volume_size': 1, 'snapshot_id': '53e28a72-bb8e-4fdc-8d66-68e1edb69875'}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d70ee6c-0cc8-4792-8974-dfb88c0ca1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d70ee6c-0cc8-4792-8974-dfb88c0ca1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be3314e0-67ac-4dd1-b435-06da8101c13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:01 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] Volume 99442fd1-817c-4bc2-a503-c6c0744b8b18: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-99442fd1-817c-4bc2-a503-c6c0744b8b18', 'volume_size': 1, 'snapshot_id': '53e28a72-bb8e-4fdc-8d66-68e1edb69875'} Apr 28 19:22:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:22:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:22:01 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] Acquiring lock "cinder-quobyte-53e28a72-bb8e-4fdc-8d66-68e1edb69875-99442fd1-817c-4bc2-a503-c6c0744b8b18" by "_create_volume_from_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:22:01 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] Lock "cinder-quobyte-53e28a72-bb8e-4fdc-8d66-68e1edb69875-99442fd1-817c-4bc2-a503-c6c0744b8b18" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:22:01 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] Creating volume 99442fd1-817c-4bc2-a503-c6c0744b8b18 from snapshot 53e28a72-bb8e-4fdc-8d66-68e1edb69875 {{(pid=83863) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 28 19:22:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:22:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:22:01 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:22:01 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:22:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:22:01 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:22:01 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] Acquiring lock "cinder-quobyte-99442fd1-817c-4bc2-a503-c6c0744b8b18" by "_copy_volume_from_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:22:01 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] Lock "cinder-quobyte-99442fd1-817c-4bc2-a503-c6c0744b8b18" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:22:01 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] snapshot: 53e28a72-bb8e-4fdc-8d66-68e1edb69875, volume: 99442fd1-817c-4bc2-a503-c6c0744b8b18, {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 19:22:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:22:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:22:01 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:22:01 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:22:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:22:01 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1659cb0-134e-4dbc-a69c-c6a652e3d814]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:22:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e.53e28a72-bb8e-4fdc-8d66-68e1edb69875 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:02 devstack sudo[91028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e.53e28a72-bb8e-4fdc-8d66-68e1edb69875 Apr 28 19:22:02 devstack sudo[91028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:02 devstack sudo[91026]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-994f92e4-4d5d-4b36-84c8-c45dd89d7de4" returned: 1 in 0.743s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-994f92e4-4d5d-4b36-84c8-c45dd89d7de4' failed. Not Retrying. {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 19:22:02 devstack cinder-volume[83863]: DEBUG cinder.volume.volume_utils [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Downloaded image d11adb91-6b52-452f-a796-9ef8412183bf ((None, [{'url': 'file:///opt/stack/data/glance/images/d11adb91-6b52-452f-a796-9ef8412183bf', 'metadata': {}}])) to volume 994f92e4-4d5d-4b36-84c8-c45dd89d7de4 successfully. {{(pid=83863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 28 19:22:02 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Temporary image d11adb91-6b52-452f-a796-9ef8412183bf for user 49def545e71141ef8b767db7c433c4f4 is deleted. {{(pid=83863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 28 19:22:02 devstack cinder-volume[83863]: DEBUG cinder.volume.volume_utils [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Marking volume 994f92e4-4d5d-4b36-84c8-c45dd89d7de4 as bootable. {{(pid=83863) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 28 19:22:02 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Copying metadata from image d11adb91-6b52-452f-a796-9ef8412183bf to 994f92e4-4d5d-4b36-84c8-c45dd89d7de4. {{(pid=83863) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 28 19:22:02 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Creating volume glance metadata for volume 994f92e4-4d5d-4b36-84c8-c45dd89d7de4 backed by image d11adb91-6b52-452f-a796-9ef8412183bf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd11adb91-6b52-452f-a796-9ef8412183bf', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83863) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 28 19:22:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (765f2306-5edc-442a-aa6c-5e4e7827b91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-994f92e4-4d5d-4b36-84c8-c45dd89d7de4', 'volume_size': 1, 'image_id': 'd11adb91-6b52-452f-a796-9ef8412183bf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d11adb91-6b52-452f-a796-9ef8412183bf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6469daf89505401a8582e1f501a60d80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd11adb91-6b52-452f-a796-9ef8412183bf', 'created_at': datetime.datetime(2026, 4, 28, 17, 9, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 17, 9, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d11adb91-6b52-452f-a796-9ef8412183bf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (582a8a22-083c-4a59-818f-4ab0a8813f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:02 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Volume volume-994f92e4-4d5d-4b36-84c8-c45dd89d7de4 (994f92e4-4d5d-4b36-84c8-c45dd89d7de4): created successfully Apr 28 19:22:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (582a8a22-083c-4a59-818f-4ab0a8813f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Flow 'volume_create_manager' (2aa572e5-efaf-465d-bd3b-fcfc360d63fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:22:02 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-4ca3480a-ff82-4258-ab51-99ec9166af4a tempest-VolumesGetTest-711720961 None] Created volume successfully. Apr 28 19:22:02 devstack sudo[91028]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e.53e28a72-bb8e-4fdc-8d66-68e1edb69875" returned: 0 in 0.777s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:02 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:22:02 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 19:22:02 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] Creating direct copy from snapshot {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 19:22:02 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a503900-ce31-4368-bca8-8c2c768cfffc]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:22:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:02 devstack sudo[91036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e Apr 28 19:22:02 devstack sudo[91036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:03 devstack cinder-volume[83863]: DEBUG oslo_service.periodic_task [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 28 19:22:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:22:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:22:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:22:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:22:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:22:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:03 devstack sudo[91041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:22:03 devstack sudo[91041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:03 devstack sudo[91036]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e" returned: 0 in 0.765s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:03 devstack cinder-volume[83863]: DEBUG cinder.utils [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] Path /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-99442fd1-817c-4bc2-a503-c6c0744b8b18 not found in is_blk_device check {{(pid=83863) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 19:22:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-99442fd1-817c-4bc2-a503-c6c0744b8b18 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:03 devstack sudo[91043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-99442fd1-817c-4bc2-a503-c6c0744b8b18 Apr 28 19:22:03 devstack sudo[91043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:04 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-289f0039-a4ac-4102-b316-849613a8bc1d tempest-VolumesGetTest-711720961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:22:04 devstack sudo[91041]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-289f0039-a4ac-4102-b316-849613a8bc1d tempest-VolumesGetTest-711720961 None] Flow 'volume_create_manager' (0ca2bc8c-db59-4746-af20-5b3da3ced865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:22:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-289f0039-a4ac-4102-b316-849613a8bc1d tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (153e74ff-ef63-40ea-87f3-8ae28663dca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.836s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:04 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:22:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-289f0039-a4ac-4102-b316-849613a8bc1d tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (153e74ff-ef63-40ea-87f3-8ae28663dca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:22:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1753428617',display_name='tempest-VolumesGetTest-Volume-1545996769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e52f01ff-7ec3-4fcd-9ca9-e38f07da3685,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8969a99ceb4c87b83e42ed49dfe036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:22:04Z,use_quota=True,user_id='49def545e71141ef8b767db7c433c4f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-289f0039-a4ac-4102-b316-849613a8bc1d tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46bf22db-bfc8-49d2-a9c6-497c529e6f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-289f0039-a4ac-4102-b316-849613a8bc1d tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46bf22db-bfc8-49d2-a9c6-497c529e6f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-289f0039-a4ac-4102-b316-849613a8bc1d tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (689b404a-be4c-47ab-b18f-38cd55bc7c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-289f0039-a4ac-4102-b316-849613a8bc1d tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (689b404a-be4c-47ab-b18f-38cd55bc7c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e52f01ff-7ec3-4fcd-9ca9-e38f07da3685', 'volume_name': 'volume-e52f01ff-7ec3-4fcd-9ca9-e38f07da3685', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-289f0039-a4ac-4102-b316-849613a8bc1d tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cdbc4f3-0af1-435e-851c-881359b1b948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-289f0039-a4ac-4102-b316-849613a8bc1d tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cdbc4f3-0af1-435e-851c-881359b1b948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-289f0039-a4ac-4102-b316-849613a8bc1d tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bb9adf0-dc09-45c4-bff5-a7d2532554b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:04 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-289f0039-a4ac-4102-b316-849613a8bc1d tempest-VolumesGetTest-711720961 None] Volume e52f01ff-7ec3-4fcd-9ca9-e38f07da3685: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e52f01ff-7ec3-4fcd-9ca9-e38f07da3685', 'volume_size': 1} Apr 28 19:22:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-289f0039-a4ac-4102-b316-849613a8bc1d tempest-VolumesGetTest-711720961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:22:09 devstack sudo[91043]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-99442fd1-817c-4bc2-a503-c6c0744b8b18" returned: 0 in 5.604s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:09 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[33302c54-c2f6-4c29-a0ef-62b7730c14ea]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:22:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:09 devstack sudo[91057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e Apr 28 19:22:09 devstack sudo[91057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:10 devstack sudo[91057]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e" returned: 0 in 0.913s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:10 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] Image conversion details: src /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e, size 1024.00 MB, duration 5.61 sec, destination /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-99442fd1-817c-4bc2-a503-c6c0744b8b18 {{(pid=83863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 19:22:10 devstack cinder-volume[83863]: INFO cinder.image.image_utils [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] Converted 1024.00 MB image at 182.69 MB/s Apr 28 19:22:10 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-99442fd1-817c-4bc2-a503-c6c0744b8b18 is being set with open permissions: ugo+rw Apr 28 19:22:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-99442fd1-817c-4bc2-a503-c6c0744b8b18 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:10 devstack sudo[91062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-99442fd1-817c-4bc2-a503-c6c0744b8b18 Apr 28 19:22:10 devstack sudo[91062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:10 devstack sudo[91062]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-99442fd1-817c-4bc2-a503-c6c0744b8b18" returned: 0 in 0.607s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:10 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] Lock "cinder-quobyte-99442fd1-817c-4bc2-a503-c6c0744b8b18" released by "_copy_volume_from_snapshot" :: held 8.774s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:22:10 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] Lock "cinder-quobyte-53e28a72-bb8e-4fdc-8d66-68e1edb69875-99442fd1-817c-4bc2-a503-c6c0744b8b18" released by "_create_volume_from_snapshot" :: held 8.816s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:22:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.841s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:22:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-289f0039-a4ac-4102-b316-849613a8bc1d tempest-VolumesGetTest-711720961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.348s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:22:10 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-289f0039-a4ac-4102-b316-849613a8bc1d tempest-VolumesGetTest-711720961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:22:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1753428617',display_name='tempest-VolumesGetTest-Volume-1545996769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e52f01ff-7ec3-4fcd-9ca9-e38f07da3685,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8969a99ceb4c87b83e42ed49dfe036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:22:04Z,use_quota=True,user_id='49def545e71141ef8b767db7c433c4f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:22:10 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-289f0039-a4ac-4102-b316-849613a8bc1d tempest-VolumesGetTest-711720961 None] Creating volume e52f01ff-7ec3-4fcd-9ca9-e38f07da3685 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:22:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-289f0039-a4ac-4102-b316-849613a8bc1d tempest-VolumesGetTest-711720961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:22:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-289f0039-a4ac-4102-b316-849613a8bc1d tempest-VolumesGetTest-711720961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:22:10 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-289f0039-a4ac-4102-b316-849613a8bc1d tempest-VolumesGetTest-711720961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:22:10 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-289f0039-a4ac-4102-b316-849613a8bc1d tempest-VolumesGetTest-711720961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:22:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-289f0039-a4ac-4102-b316-849613a8bc1d tempest-VolumesGetTest-711720961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:22:10 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-289f0039-a4ac-4102-b316-849613a8bc1d tempest-VolumesGetTest-711720961 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:22:10 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-289f0039-a4ac-4102-b316-849613a8bc1d tempest-VolumesGetTest-711720961 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:22:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-289f0039-a4ac-4102-b316-849613a8bc1d tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e52f01ff-7ec3-4fcd-9ca9-e38f07da3685 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:10 devstack sudo[91065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e52f01ff-7ec3-4fcd-9ca9-e38f07da3685 1073741824 Apr 28 19:22:10 devstack sudo[91065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be3314e0-67ac-4dd1-b435-06da8101c13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99442fd1-817c-4bc2-a503-c6c0744b8b18', 'volume_size': 1, 'snapshot_id': '53e28a72-bb8e-4fdc-8d66-68e1edb69875'}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acf08266-f9cf-4194-888e-c54977750f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:10 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] Volume volume-99442fd1-817c-4bc2-a503-c6c0744b8b18 (99442fd1-817c-4bc2-a503-c6c0744b8b18): created successfully Apr 28 19:22:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acf08266-f9cf-4194-888e-c54977750f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] Flow 'volume_create_manager' (073a9f4c-5649-48ac-a154-6382cf62cf3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:22:10 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-47a21f3b-1076-44b9-a6f0-4e1a4720bc2d tempest-VolumesDeleteCascade-1370866783 None] Created volume successfully. Apr 28 19:22:11 devstack sudo[91065]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-289f0039-a4ac-4102-b316-849613a8bc1d tempest-VolumesGetTest-711720961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e52f01ff-7ec3-4fcd-9ca9-e38f07da3685 1073741824" returned: 0 in 0.898s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-289f0039-a4ac-4102-b316-849613a8bc1d tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e52f01ff-7ec3-4fcd-9ca9-e38f07da3685 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:11 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-44d89fb4-ad5e-4e4e-9279-015f5749bb5d tempest-VolumesDeleteCascade-1370866783 None] Acquiring lock "cinder-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:22:11 devstack sudo[91072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e52f01ff-7ec3-4fcd-9ca9-e38f07da3685 Apr 28 19:22:11 devstack sudo[91072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:11 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-44d89fb4-ad5e-4e4e-9279-015f5749bb5d tempest-VolumesDeleteCascade-1370866783 None] Lock "cinder-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:22:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-44d89fb4-ad5e-4e4e-9279-015f5749bb5d tempest-VolumesDeleteCascade-1370866783 None] Performing cascade delete. {{(pid=83863) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 28 19:22:11 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-44d89fb4-ad5e-4e4e-9279-015f5749bb5d tempest-VolumesDeleteCascade-1370866783 None] Acquiring lock "cinder-53e28a72-bb8e-4fdc-8d66-68e1edb69875-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:22:11 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-44d89fb4-ad5e-4e4e-9279-015f5749bb5d tempest-VolumesDeleteCascade-1370866783 None] Lock "cinder-53e28a72-bb8e-4fdc-8d66-68e1edb69875-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:22:11 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-44d89fb4-ad5e-4e4e-9279-015f5749bb5d tempest-VolumesDeleteCascade-1370866783 None] Acquiring lock "cinder-quobyte-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:22:11 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-44d89fb4-ad5e-4e4e-9279-015f5749bb5d tempest-VolumesDeleteCascade-1370866783 None] Lock "cinder-quobyte-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:22:11 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-44d89fb4-ad5e-4e4e-9279-015f5749bb5d tempest-VolumesDeleteCascade-1370866783 None] Acquiring lock "cinder-quobyte-53e28a72-bb8e-4fdc-8d66-68e1edb69875" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:22:11 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-44d89fb4-ad5e-4e4e-9279-015f5749bb5d tempest-VolumesDeleteCascade-1370866783 None] Lock "cinder-quobyte-53e28a72-bb8e-4fdc-8d66-68e1edb69875" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:22:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-44d89fb4-ad5e-4e4e-9279-015f5749bb5d tempest-VolumesDeleteCascade-1370866783 None] Deleting offline snapshot 53e28a72-bb8e-4fdc-8d66-68e1edb69875 of volume 4c4bb39c-1d6c-4e99-acc9-6a2259570e4e {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 19:22:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-44d89fb4-ad5e-4e4e-9279-015f5749bb5d tempest-VolumesDeleteCascade-1370866783 None] snapshot_file for this snap is: volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e.53e28a72-bb8e-4fdc-8d66-68e1edb69875 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 19:22:11 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9958f2f9-400d-4ffd-ac2e-be6441bda00a]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:22:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-44d89fb4-ad5e-4e4e-9279-015f5749bb5d tempest-VolumesDeleteCascade-1370866783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e.53e28a72-bb8e-4fdc-8d66-68e1edb69875 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:12 devstack sudo[91074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e.53e28a72-bb8e-4fdc-8d66-68e1edb69875 Apr 28 19:22:12 devstack sudo[91074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:12 devstack sudo[91072]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-289f0039-a4ac-4102-b316-849613a8bc1d tempest-VolumesGetTest-711720961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e52f01ff-7ec3-4fcd-9ca9-e38f07da3685" returned: 0 in 0.698s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:12 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-289f0039-a4ac-4102-b316-849613a8bc1d tempest-VolumesGetTest-711720961 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:22:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-289f0039-a4ac-4102-b316-849613a8bc1d tempest-VolumesGetTest-711720961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.653s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:22:12 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-289f0039-a4ac-4102-b316-849613a8bc1d tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bb9adf0-dc09-45c4-bff5-a7d2532554b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e52f01ff-7ec3-4fcd-9ca9-e38f07da3685', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:12 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-289f0039-a4ac-4102-b316-849613a8bc1d tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e391be1-3230-4168-8363-bd0936b2f4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:12 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-289f0039-a4ac-4102-b316-849613a8bc1d tempest-VolumesGetTest-711720961 None] Volume volume-e52f01ff-7ec3-4fcd-9ca9-e38f07da3685 (e52f01ff-7ec3-4fcd-9ca9-e38f07da3685): created successfully Apr 28 19:22:12 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-289f0039-a4ac-4102-b316-849613a8bc1d tempest-VolumesGetTest-711720961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e391be1-3230-4168-8363-bd0936b2f4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:12 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-289f0039-a4ac-4102-b316-849613a8bc1d tempest-VolumesGetTest-711720961 None] Flow 'volume_create_manager' (0ca2bc8c-db59-4746-af20-5b3da3ced865) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:22:12 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-289f0039-a4ac-4102-b316-849613a8bc1d tempest-VolumesGetTest-711720961 None] Created volume successfully. Apr 28 19:22:12 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-810cced3-8c7d-4b3d-9898-2e784b5ab641 tempest-VolumesServicesTestJSON-20007745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:22:12 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-810cced3-8c7d-4b3d-9898-2e784b5ab641 tempest-VolumesServicesTestJSON-20007745 None] Flow 'volume_create_manager' (9618ea5e-d4a8-46ff-8efa-113659acbe03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:22:12 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-810cced3-8c7d-4b3d-9898-2e784b5ab641 tempest-VolumesServicesTestJSON-20007745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (653ae729-a9c4-48be-9ddb-4601fbb6e18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:12 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-810cced3-8c7d-4b3d-9898-2e784b5ab641 tempest-VolumesServicesTestJSON-20007745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (653ae729-a9c4-48be-9ddb-4601fbb6e18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-984230537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbbadb55-d2af-417e-8b0e-db0c1f01eb03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='343bb772add54382bb2eb63231713af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:22:13Z,use_quota=True,user_id='4581fd8b070e44efb4925d1230ae35ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:12 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-810cced3-8c7d-4b3d-9898-2e784b5ab641 tempest-VolumesServicesTestJSON-20007745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa3ccb4a-35d5-443f-be6a-0a3f033260dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:12 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-810cced3-8c7d-4b3d-9898-2e784b5ab641 tempest-VolumesServicesTestJSON-20007745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa3ccb4a-35d5-443f-be6a-0a3f033260dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:12 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-810cced3-8c7d-4b3d-9898-2e784b5ab641 tempest-VolumesServicesTestJSON-20007745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4420f020-1a37-483d-b4ae-eaa83b2a08f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:12 devstack sudo[91074]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:12 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-810cced3-8c7d-4b3d-9898-2e784b5ab641 tempest-VolumesServicesTestJSON-20007745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4420f020-1a37-483d-b4ae-eaa83b2a08f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbbadb55-d2af-417e-8b0e-db0c1f01eb03', 'volume_name': 'volume-cbbadb55-d2af-417e-8b0e-db0c1f01eb03', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:12 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-810cced3-8c7d-4b3d-9898-2e784b5ab641 tempest-VolumesServicesTestJSON-20007745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa14c1a8-2d91-4618-8536-95138ba960df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:12 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-810cced3-8c7d-4b3d-9898-2e784b5ab641 tempest-VolumesServicesTestJSON-20007745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa14c1a8-2d91-4618-8536-95138ba960df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:12 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-810cced3-8c7d-4b3d-9898-2e784b5ab641 tempest-VolumesServicesTestJSON-20007745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6309a28a-46b3-4f66-a472-4f74b44ed808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:12 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-810cced3-8c7d-4b3d-9898-2e784b5ab641 tempest-VolumesServicesTestJSON-20007745 None] Volume cbbadb55-d2af-417e-8b0e-db0c1f01eb03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbbadb55-d2af-417e-8b0e-db0c1f01eb03', 'volume_size': 1} Apr 28 19:22:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-810cced3-8c7d-4b3d-9898-2e784b5ab641 tempest-VolumesServicesTestJSON-20007745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:22:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-810cced3-8c7d-4b3d-9898-2e784b5ab641 tempest-VolumesServicesTestJSON-20007745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:22:12 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-810cced3-8c7d-4b3d-9898-2e784b5ab641 tempest-VolumesServicesTestJSON-20007745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-984230537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbbadb55-d2af-417e-8b0e-db0c1f01eb03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='343bb772add54382bb2eb63231713af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:22:13Z,use_quota=True,user_id='4581fd8b070e44efb4925d1230ae35ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:22:12 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-810cced3-8c7d-4b3d-9898-2e784b5ab641 tempest-VolumesServicesTestJSON-20007745 None] Creating volume cbbadb55-d2af-417e-8b0e-db0c1f01eb03 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:22:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-810cced3-8c7d-4b3d-9898-2e784b5ab641 tempest-VolumesServicesTestJSON-20007745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:22:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-810cced3-8c7d-4b3d-9898-2e784b5ab641 tempest-VolumesServicesTestJSON-20007745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:22:12 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-810cced3-8c7d-4b3d-9898-2e784b5ab641 tempest-VolumesServicesTestJSON-20007745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:22:12 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-810cced3-8c7d-4b3d-9898-2e784b5ab641 tempest-VolumesServicesTestJSON-20007745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:22:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-810cced3-8c7d-4b3d-9898-2e784b5ab641 tempest-VolumesServicesTestJSON-20007745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:22:12 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-810cced3-8c7d-4b3d-9898-2e784b5ab641 tempest-VolumesServicesTestJSON-20007745 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:22:12 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-810cced3-8c7d-4b3d-9898-2e784b5ab641 tempest-VolumesServicesTestJSON-20007745 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:22:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-810cced3-8c7d-4b3d-9898-2e784b5ab641 tempest-VolumesServicesTestJSON-20007745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cbbadb55-d2af-417e-8b0e-db0c1f01eb03 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-44d89fb4-ad5e-4e4e-9279-015f5749bb5d tempest-VolumesDeleteCascade-1370866783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e.53e28a72-bb8e-4fdc-8d66-68e1edb69875" returned: 0 in 0.828s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:12 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-44d89fb4-ad5e-4e4e-9279-015f5749bb5d tempest-VolumesDeleteCascade-1370866783 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:22:12 devstack sudo[91080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cbbadb55-d2af-417e-8b0e-db0c1f01eb03 1073741824 Apr 28 19:22:12 devstack sudo[91080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:12 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e3749c-b441-4153-83ab-cd547f80ffb4]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:22:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-44d89fb4-ad5e-4e4e-9279-015f5749bb5d tempest-VolumesDeleteCascade-1370866783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:12 devstack sudo[91082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e Apr 28 19:22:12 devstack sudo[91082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:13 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-069360ae-481d-4e92-9eb3-2f782f3237d9 tempest-VolumesGetTest-711720961 None] Acquiring lock "cinder-e52f01ff-7ec3-4fcd-9ca9-e38f07da3685-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:22:13 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-069360ae-481d-4e92-9eb3-2f782f3237d9 tempest-VolumesGetTest-711720961 None] Lock "cinder-e52f01ff-7ec3-4fcd-9ca9-e38f07da3685-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:22:13 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-069360ae-481d-4e92-9eb3-2f782f3237d9 tempest-VolumesGetTest-711720961 None] Acquiring lock "cinder-quobyte-e52f01ff-7ec3-4fcd-9ca9-e38f07da3685" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:22:13 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-069360ae-481d-4e92-9eb3-2f782f3237d9 tempest-VolumesGetTest-711720961 None] Lock "cinder-quobyte-e52f01ff-7ec3-4fcd-9ca9-e38f07da3685" acquired by "delete_volume" :: waited 0.019s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:22:13 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc2662e-e6ab-4b4a-8e72-89521765e0fc]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:22:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-069360ae-481d-4e92-9eb3-2f782f3237d9 tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e52f01ff-7ec3-4fcd-9ca9-e38f07da3685 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:13 devstack sudo[91087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e52f01ff-7ec3-4fcd-9ca9-e38f07da3685 Apr 28 19:22:13 devstack sudo[91087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:13 devstack sudo[91082]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-44d89fb4-ad5e-4e4e-9279-015f5749bb5d tempest-VolumesDeleteCascade-1370866783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e" returned: 0 in 0.760s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-44d89fb4-ad5e-4e4e-9279-015f5749bb5d tempest-VolumesDeleteCascade-1370866783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e.53e28a72-bb8e-4fdc-8d66-68e1edb69875 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:13 devstack sudo[91080]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-810cced3-8c7d-4b3d-9898-2e784b5ab641 tempest-VolumesServicesTestJSON-20007745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cbbadb55-d2af-417e-8b0e-db0c1f01eb03 1073741824" returned: 0 in 0.818s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:13 devstack sudo[91092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e.53e28a72-bb8e-4fdc-8d66-68e1edb69875 Apr 28 19:22:13 devstack sudo[91092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-810cced3-8c7d-4b3d-9898-2e784b5ab641 tempest-VolumesServicesTestJSON-20007745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cbbadb55-d2af-417e-8b0e-db0c1f01eb03 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:13 devstack sudo[91094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cbbadb55-d2af-417e-8b0e-db0c1f01eb03 Apr 28 19:22:13 devstack sudo[91094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:14 devstack sudo[91087]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-069360ae-481d-4e92-9eb3-2f782f3237d9 tempest-VolumesGetTest-711720961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e52f01ff-7ec3-4fcd-9ca9-e38f07da3685" returned: 0 in 0.773s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-069360ae-481d-4e92-9eb3-2f782f3237d9 tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e52f01ff-7ec3-4fcd-9ca9-e38f07da3685 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:14 devstack sudo[91101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e52f01ff-7ec3-4fcd-9ca9-e38f07da3685 Apr 28 19:22:14 devstack sudo[91101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:14 devstack sudo[91094]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-810cced3-8c7d-4b3d-9898-2e784b5ab641 tempest-VolumesServicesTestJSON-20007745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cbbadb55-d2af-417e-8b0e-db0c1f01eb03" returned: 0 in 0.625s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:14 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-810cced3-8c7d-4b3d-9898-2e784b5ab641 tempest-VolumesServicesTestJSON-20007745 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:22:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-810cced3-8c7d-4b3d-9898-2e784b5ab641 tempest-VolumesServicesTestJSON-20007745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:22:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-810cced3-8c7d-4b3d-9898-2e784b5ab641 tempest-VolumesServicesTestJSON-20007745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6309a28a-46b3-4f66-a472-4f74b44ed808) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbbadb55-d2af-417e-8b0e-db0c1f01eb03', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-810cced3-8c7d-4b3d-9898-2e784b5ab641 tempest-VolumesServicesTestJSON-20007745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e794904-2e01-48e1-80c8-8ef6ba73761d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:14 devstack sudo[91092]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-44d89fb4-ad5e-4e4e-9279-015f5749bb5d tempest-VolumesDeleteCascade-1370866783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e.53e28a72-bb8e-4fdc-8d66-68e1edb69875" returned: 0 in 0.716s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-44d89fb4-ad5e-4e4e-9279-015f5749bb5d tempest-VolumesDeleteCascade-1370866783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e.53e28a72-bb8e-4fdc-8d66-68e1edb69875 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:14 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-810cced3-8c7d-4b3d-9898-2e784b5ab641 tempest-VolumesServicesTestJSON-20007745 None] Volume volume-cbbadb55-d2af-417e-8b0e-db0c1f01eb03 (cbbadb55-d2af-417e-8b0e-db0c1f01eb03): created successfully Apr 28 19:22:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-810cced3-8c7d-4b3d-9898-2e784b5ab641 tempest-VolumesServicesTestJSON-20007745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e794904-2e01-48e1-80c8-8ef6ba73761d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:14 devstack sudo[91105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e.53e28a72-bb8e-4fdc-8d66-68e1edb69875 Apr 28 19:22:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-810cced3-8c7d-4b3d-9898-2e784b5ab641 tempest-VolumesServicesTestJSON-20007745 None] Flow 'volume_create_manager' (9618ea5e-d4a8-46ff-8efa-113659acbe03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:22:14 devstack sudo[91105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:14 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-810cced3-8c7d-4b3d-9898-2e784b5ab641 tempest-VolumesServicesTestJSON-20007745 None] Created volume successfully. Apr 28 19:22:14 devstack sudo[91101]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-069360ae-481d-4e92-9eb3-2f782f3237d9 tempest-VolumesGetTest-711720961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e52f01ff-7ec3-4fcd-9ca9-e38f07da3685" returned: 0 in 0.650s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:14 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-069360ae-481d-4e92-9eb3-2f782f3237d9 tempest-VolumesGetTest-711720961 None] Lock "cinder-quobyte-e52f01ff-7ec3-4fcd-9ca9-e38f07da3685" released by "delete_volume" :: held 1.477s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:22:14 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-069360ae-481d-4e92-9eb3-2f782f3237d9 tempest-VolumesGetTest-711720961 None] Created reservations ['f91f3b88-6091-4a54-a1bc-7eded35fa4f5', 'a976e125-e9ba-4cfc-8b70-f776f9fc2928', 'f43b1c34-66b2-44e7-9893-8b7042e32264', '278bc2de-6b3b-4a87-a565-0e762fefbf71'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:22:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-069360ae-481d-4e92-9eb3-2f782f3237d9 tempest-VolumesGetTest-711720961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:22:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-069360ae-481d-4e92-9eb3-2f782f3237d9 tempest-VolumesGetTest-711720961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:22:14 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-069360ae-481d-4e92-9eb3-2f782f3237d9 tempest-VolumesGetTest-711720961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:22:14 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-069360ae-481d-4e92-9eb3-2f782f3237d9 tempest-VolumesGetTest-711720961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:22:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-069360ae-481d-4e92-9eb3-2f782f3237d9 tempest-VolumesGetTest-711720961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:22:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-069360ae-481d-4e92-9eb3-2f782f3237d9 tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:14 devstack sudo[91109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:22:14 devstack sudo[91109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:14 devstack sudo[91105]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-44d89fb4-ad5e-4e4e-9279-015f5749bb5d tempest-VolumesDeleteCascade-1370866783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e.53e28a72-bb8e-4fdc-8d66-68e1edb69875" returned: 0 in 0.645s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:14 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-44d89fb4-ad5e-4e4e-9279-015f5749bb5d tempest-VolumesDeleteCascade-1370866783 None] Lock "cinder-quobyte-53e28a72-bb8e-4fdc-8d66-68e1edb69875" released by "_delete_snapshot" :: held 3.093s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:22:14 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-44d89fb4-ad5e-4e4e-9279-015f5749bb5d tempest-VolumesDeleteCascade-1370866783 None] Lock "cinder-quobyte-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e" released by "delete_snapshot" :: held 3.118s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:22:14 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-92e12aa1-66f7-421c-b5db-dc15e94d319f tempest-VolumesServicesTestJSON-20007745 None] Acquiring lock "cinder-cbbadb55-d2af-417e-8b0e-db0c1f01eb03-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:22:14 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-92e12aa1-66f7-421c-b5db-dc15e94d319f tempest-VolumesServicesTestJSON-20007745 None] Lock "cinder-cbbadb55-d2af-417e-8b0e-db0c1f01eb03-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:22:15 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-44d89fb4-ad5e-4e4e-9279-015f5749bb5d tempest-VolumesDeleteCascade-1370866783 None] Created reservations ['327ad668-7120-4318-8f04-283a9ddf64b9', '6ee32741-c2c0-4e49-bf2a-76fe5d65d3e5', '87383607-5d9c-4e50-baf7-fee37b34f04d', 'bafb1370-a4b1-42fc-974c-af9bb1c9faa4'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:22:15 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-92e12aa1-66f7-421c-b5db-dc15e94d319f tempest-VolumesServicesTestJSON-20007745 None] Acquiring lock "cinder-quobyte-cbbadb55-d2af-417e-8b0e-db0c1f01eb03" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:22:15 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-92e12aa1-66f7-421c-b5db-dc15e94d319f tempest-VolumesServicesTestJSON-20007745 None] Lock "cinder-quobyte-cbbadb55-d2af-417e-8b0e-db0c1f01eb03" acquired by "delete_volume" :: waited 0.019s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:22:15 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[04029ea7-50fc-42eb-babd-48f8f7c9d793]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:22:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-92e12aa1-66f7-421c-b5db-dc15e94d319f tempest-VolumesServicesTestJSON-20007745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cbbadb55-d2af-417e-8b0e-db0c1f01eb03 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:15 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-44d89fb4-ad5e-4e4e-9279-015f5749bb5d tempest-VolumesDeleteCascade-1370866783 None] Delete snapshot completed successfully. Apr 28 19:22:15 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-44d89fb4-ad5e-4e4e-9279-015f5749bb5d tempest-VolumesDeleteCascade-1370866783 None] Lock "cinder-53e28a72-bb8e-4fdc-8d66-68e1edb69875-delete_snapshot" released by "delete_snapshot" :: held 3.390s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:22:15 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-44d89fb4-ad5e-4e4e-9279-015f5749bb5d tempest-VolumesDeleteCascade-1370866783 None] Snapshots deleted, issuing volume delete {{(pid=83863) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 28 19:22:15 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-44d89fb4-ad5e-4e4e-9279-015f5749bb5d tempest-VolumesDeleteCascade-1370866783 None] Acquiring lock "cinder-quobyte-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:22:15 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-44d89fb4-ad5e-4e4e-9279-015f5749bb5d tempest-VolumesDeleteCascade-1370866783 None] Lock "cinder-quobyte-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e" acquired by "delete_volume" :: waited 0.015s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:22:15 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e3659a-3ecc-4429-9893-16be2a3f63be]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:22:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-44d89fb4-ad5e-4e4e-9279-015f5749bb5d tempest-VolumesDeleteCascade-1370866783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:15 devstack sudo[91111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cbbadb55-d2af-417e-8b0e-db0c1f01eb03 Apr 28 19:22:15 devstack sudo[91111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:15 devstack sudo[91112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e Apr 28 19:22:15 devstack sudo[91112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:15 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-275d8345-54bd-4a7e-a5d8-75c706063db1 tempest-VolumesGetTest-711720961 None] Acquiring lock "cinder-994f92e4-4d5d-4b36-84c8-c45dd89d7de4-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:22:15 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-275d8345-54bd-4a7e-a5d8-75c706063db1 tempest-VolumesGetTest-711720961 None] Lock "cinder-994f92e4-4d5d-4b36-84c8-c45dd89d7de4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:22:15 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-275d8345-54bd-4a7e-a5d8-75c706063db1 tempest-VolumesGetTest-711720961 None] Acquiring lock "cinder-quobyte-994f92e4-4d5d-4b36-84c8-c45dd89d7de4" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:22:15 devstack sudo[91109]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-069360ae-481d-4e92-9eb3-2f782f3237d9 tempest-VolumesGetTest-711720961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.710s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:15 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-069360ae-481d-4e92-9eb3-2f782f3237d9 tempest-VolumesGetTest-711720961 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:22:15 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-069360ae-481d-4e92-9eb3-2f782f3237d9 tempest-VolumesGetTest-711720961 None] Deleted volume successfully. Apr 28 19:22:15 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-275d8345-54bd-4a7e-a5d8-75c706063db1 tempest-VolumesGetTest-711720961 None] Lock "cinder-quobyte-994f92e4-4d5d-4b36-84c8-c45dd89d7de4" acquired by "delete_volume" :: waited 0.026s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:22:15 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-069360ae-481d-4e92-9eb3-2f782f3237d9 tempest-VolumesGetTest-711720961 None] Lock "cinder-e52f01ff-7ec3-4fcd-9ca9-e38f07da3685-delete_volume" released by "delete_volume" :: held 2.425s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:22:15 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b565422-308e-4402-a00a-e8304f0c9066]: (4, 'raw') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:22:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-275d8345-54bd-4a7e-a5d8-75c706063db1 tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-994f92e4-4d5d-4b36-84c8-c45dd89d7de4 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:15 devstack sudo[91116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-994f92e4-4d5d-4b36-84c8-c45dd89d7de4 Apr 28 19:22:15 devstack sudo[91116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:15 devstack sudo[91111]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-92e12aa1-66f7-421c-b5db-dc15e94d319f tempest-VolumesServicesTestJSON-20007745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cbbadb55-d2af-417e-8b0e-db0c1f01eb03" returned: 0 in 0.810s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-92e12aa1-66f7-421c-b5db-dc15e94d319f tempest-VolumesServicesTestJSON-20007745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cbbadb55-d2af-417e-8b0e-db0c1f01eb03 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:15 devstack sudo[91124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cbbadb55-d2af-417e-8b0e-db0c1f01eb03 Apr 28 19:22:15 devstack sudo[91124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:15 devstack sudo[91112]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-44d89fb4-ad5e-4e4e-9279-015f5749bb5d tempest-VolumesDeleteCascade-1370866783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e" returned: 0 in 0.809s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-44d89fb4-ad5e-4e4e-9279-015f5749bb5d tempest-VolumesDeleteCascade-1370866783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:16 devstack sudo[91126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e Apr 28 19:22:16 devstack sudo[91126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:16 devstack sudo[91116]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-275d8345-54bd-4a7e-a5d8-75c706063db1 tempest-VolumesGetTest-711720961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-994f92e4-4d5d-4b36-84c8-c45dd89d7de4" returned: 0 in 0.720s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-275d8345-54bd-4a7e-a5d8-75c706063db1 tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-994f92e4-4d5d-4b36-84c8-c45dd89d7de4 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:16 devstack sudo[91130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-994f92e4-4d5d-4b36-84c8-c45dd89d7de4 Apr 28 19:22:16 devstack sudo[91130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:16 devstack sudo[91124]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-92e12aa1-66f7-421c-b5db-dc15e94d319f tempest-VolumesServicesTestJSON-20007745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cbbadb55-d2af-417e-8b0e-db0c1f01eb03" returned: 0 in 0.669s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:16 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-92e12aa1-66f7-421c-b5db-dc15e94d319f tempest-VolumesServicesTestJSON-20007745 None] Lock "cinder-quobyte-cbbadb55-d2af-417e-8b0e-db0c1f01eb03" released by "delete_volume" :: held 1.534s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:22:16 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-92e12aa1-66f7-421c-b5db-dc15e94d319f tempest-VolumesServicesTestJSON-20007745 None] Created reservations ['88e9988f-00e3-46a2-b74d-64304519932c', '1df3aabc-10ef-402f-88f4-2e6748c50191', 'b958710a-b805-4e7d-8884-8d66064a5147', '5e3b854d-e086-4e23-af00-7c04eeb075df'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:22:16 devstack sudo[91126]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-44d89fb4-ad5e-4e4e-9279-015f5749bb5d tempest-VolumesDeleteCascade-1370866783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e" returned: 0 in 0.659s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:16 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-44d89fb4-ad5e-4e4e-9279-015f5749bb5d tempest-VolumesDeleteCascade-1370866783 None] Lock "cinder-quobyte-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e" released by "delete_volume" :: held 1.542s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:22:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-92e12aa1-66f7-421c-b5db-dc15e94d319f tempest-VolumesServicesTestJSON-20007745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:22:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-92e12aa1-66f7-421c-b5db-dc15e94d319f tempest-VolumesServicesTestJSON-20007745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:22:16 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-92e12aa1-66f7-421c-b5db-dc15e94d319f tempest-VolumesServicesTestJSON-20007745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:22:16 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-92e12aa1-66f7-421c-b5db-dc15e94d319f tempest-VolumesServicesTestJSON-20007745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:22:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-92e12aa1-66f7-421c-b5db-dc15e94d319f tempest-VolumesServicesTestJSON-20007745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:22:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-92e12aa1-66f7-421c-b5db-dc15e94d319f tempest-VolumesServicesTestJSON-20007745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:16 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-44d89fb4-ad5e-4e4e-9279-015f5749bb5d tempest-VolumesDeleteCascade-1370866783 None] Created reservations ['d3c23258-eb9b-41e0-a982-f10c5a61a747', '19e12a55-0699-4bf7-b1f3-830cb2c0a910', 'b1c38516-f0ae-47cd-9e29-c002523a5410', '398ab760-0e44-41e5-b778-8072ec68770d'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:22:16 devstack sudo[91134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:22:16 devstack sudo[91134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-44d89fb4-ad5e-4e4e-9279-015f5749bb5d tempest-VolumesDeleteCascade-1370866783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:22:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-44d89fb4-ad5e-4e4e-9279-015f5749bb5d tempest-VolumesDeleteCascade-1370866783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:22:16 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-44d89fb4-ad5e-4e4e-9279-015f5749bb5d tempest-VolumesDeleteCascade-1370866783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:22:16 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-44d89fb4-ad5e-4e4e-9279-015f5749bb5d tempest-VolumesDeleteCascade-1370866783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:22:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-44d89fb4-ad5e-4e4e-9279-015f5749bb5d tempest-VolumesDeleteCascade-1370866783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:22:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-44d89fb4-ad5e-4e4e-9279-015f5749bb5d tempest-VolumesDeleteCascade-1370866783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:16 devstack sudo[91136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:22:16 devstack sudo[91136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:17 devstack sudo[91130]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-275d8345-54bd-4a7e-a5d8-75c706063db1 tempest-VolumesGetTest-711720961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-994f92e4-4d5d-4b36-84c8-c45dd89d7de4" returned: 1 in 0.785s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-275d8345-54bd-4a7e-a5d8-75c706063db1 tempest-VolumesGetTest-711720961 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-994f92e4-4d5d-4b36-84c8-c45dd89d7de4' failed. Not Retrying. {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 19:22:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-275d8345-54bd-4a7e-a5d8-75c706063db1 tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-994f92e4-4d5d-4b36-84c8-c45dd89d7de4 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:17 devstack sudo[91141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-994f92e4-4d5d-4b36-84c8-c45dd89d7de4 Apr 28 19:22:17 devstack sudo[91141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:17 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3a14834c-f24c-4a42-9517-1a28f596f822 tempest-VolumesDeleteCascade-1370866783 None] Acquiring lock "cinder-99442fd1-817c-4bc2-a503-c6c0744b8b18-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:22:17 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3a14834c-f24c-4a42-9517-1a28f596f822 tempest-VolumesDeleteCascade-1370866783 None] Lock "cinder-99442fd1-817c-4bc2-a503-c6c0744b8b18-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:22:17 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3a14834c-f24c-4a42-9517-1a28f596f822 tempest-VolumesDeleteCascade-1370866783 None] Acquiring lock "cinder-quobyte-99442fd1-817c-4bc2-a503-c6c0744b8b18" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:22:17 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3a14834c-f24c-4a42-9517-1a28f596f822 tempest-VolumesDeleteCascade-1370866783 None] Lock "cinder-quobyte-99442fd1-817c-4bc2-a503-c6c0744b8b18" acquired by "delete_volume" :: waited 0.030s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:22:17 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a072eec-f844-4b0b-b852-4b4ebe70e10c]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:22:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3a14834c-f24c-4a42-9517-1a28f596f822 tempest-VolumesDeleteCascade-1370866783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-99442fd1-817c-4bc2-a503-c6c0744b8b18 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:17 devstack sudo[91134]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-92e12aa1-66f7-421c-b5db-dc15e94d319f tempest-VolumesServicesTestJSON-20007745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.777s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:17 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-92e12aa1-66f7-421c-b5db-dc15e94d319f tempest-VolumesServicesTestJSON-20007745 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:22:17 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-92e12aa1-66f7-421c-b5db-dc15e94d319f tempest-VolumesServicesTestJSON-20007745 None] Deleted volume successfully. Apr 28 19:22:17 devstack sudo[91136]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-44d89fb4-ad5e-4e4e-9279-015f5749bb5d tempest-VolumesDeleteCascade-1370866783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.703s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:17 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-44d89fb4-ad5e-4e4e-9279-015f5749bb5d tempest-VolumesDeleteCascade-1370866783 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:22:17 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-44d89fb4-ad5e-4e4e-9279-015f5749bb5d tempest-VolumesDeleteCascade-1370866783 None] Deleted volume successfully. Apr 28 19:22:17 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-92e12aa1-66f7-421c-b5db-dc15e94d319f tempest-VolumesServicesTestJSON-20007745 None] Lock "cinder-cbbadb55-d2af-417e-8b0e-db0c1f01eb03-delete_volume" released by "delete_volume" :: held 2.602s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:22:17 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-44d89fb4-ad5e-4e4e-9279-015f5749bb5d tempest-VolumesDeleteCascade-1370866783 None] Lock "cinder-4c4bb39c-1d6c-4e99-acc9-6a2259570e4e-delete_volume" released by "delete_volume" :: held 5.944s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:22:17 devstack sudo[91145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-99442fd1-817c-4bc2-a503-c6c0744b8b18 Apr 28 19:22:17 devstack sudo[91145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:17 devstack sudo[91141]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-275d8345-54bd-4a7e-a5d8-75c706063db1 tempest-VolumesGetTest-711720961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-994f92e4-4d5d-4b36-84c8-c45dd89d7de4" returned: 0 in 0.829s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:17 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-275d8345-54bd-4a7e-a5d8-75c706063db1 tempest-VolumesGetTest-711720961 None] Lock "cinder-quobyte-994f92e4-4d5d-4b36-84c8-c45dd89d7de4" released by "delete_volume" :: held 2.411s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:22:18 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-275d8345-54bd-4a7e-a5d8-75c706063db1 tempest-VolumesGetTest-711720961 None] Created reservations ['3a75176a-e885-4933-b6c5-5cce99ee0483', '3dc775f1-22a7-49ff-906b-3598ce952275', '3167d62c-54ab-4183-bede-3f0447723c46', '5ede737f-99e8-43fe-ae8f-ff5d61804d32'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:22:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-275d8345-54bd-4a7e-a5d8-75c706063db1 tempest-VolumesGetTest-711720961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:22:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-275d8345-54bd-4a7e-a5d8-75c706063db1 tempest-VolumesGetTest-711720961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:22:18 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-275d8345-54bd-4a7e-a5d8-75c706063db1 tempest-VolumesGetTest-711720961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:22:18 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-275d8345-54bd-4a7e-a5d8-75c706063db1 tempest-VolumesGetTest-711720961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:22:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-275d8345-54bd-4a7e-a5d8-75c706063db1 tempest-VolumesGetTest-711720961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:22:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-275d8345-54bd-4a7e-a5d8-75c706063db1 tempest-VolumesGetTest-711720961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:18 devstack sudo[91150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:22:18 devstack sudo[91150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:18 devstack sudo[91145]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3a14834c-f24c-4a42-9517-1a28f596f822 tempest-VolumesDeleteCascade-1370866783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-99442fd1-817c-4bc2-a503-c6c0744b8b18" returned: 0 in 0.791s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3a14834c-f24c-4a42-9517-1a28f596f822 tempest-VolumesDeleteCascade-1370866783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-99442fd1-817c-4bc2-a503-c6c0744b8b18 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:18 devstack sudo[91153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-99442fd1-817c-4bc2-a503-c6c0744b8b18 Apr 28 19:22:18 devstack sudo[91153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:18 devstack sudo[91150]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-275d8345-54bd-4a7e-a5d8-75c706063db1 tempest-VolumesGetTest-711720961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.648s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:18 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-275d8345-54bd-4a7e-a5d8-75c706063db1 tempest-VolumesGetTest-711720961 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:22:18 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-275d8345-54bd-4a7e-a5d8-75c706063db1 tempest-VolumesGetTest-711720961 None] Deleted volume successfully. Apr 28 19:22:18 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-275d8345-54bd-4a7e-a5d8-75c706063db1 tempest-VolumesGetTest-711720961 None] Lock "cinder-994f92e4-4d5d-4b36-84c8-c45dd89d7de4-delete_volume" released by "delete_volume" :: held 3.308s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:22:18 devstack sudo[91153]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3a14834c-f24c-4a42-9517-1a28f596f822 tempest-VolumesDeleteCascade-1370866783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-99442fd1-817c-4bc2-a503-c6c0744b8b18" returned: 0 in 0.703s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:18 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3a14834c-f24c-4a42-9517-1a28f596f822 tempest-VolumesDeleteCascade-1370866783 None] Lock "cinder-quobyte-99442fd1-817c-4bc2-a503-c6c0744b8b18" released by "delete_volume" :: held 1.550s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:22:19 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-3a14834c-f24c-4a42-9517-1a28f596f822 tempest-VolumesDeleteCascade-1370866783 None] Created reservations ['96a2a198-f099-4930-ba50-35a0d746a596', 'f18b3746-8284-40ff-bec7-55f4cc7ab859', 'f66a6be6-5fda-4da3-b453-88cc396d38b5', 'ffbe9bc5-2971-4644-8eb9-ba05ce1064e7'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:22:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3a14834c-f24c-4a42-9517-1a28f596f822 tempest-VolumesDeleteCascade-1370866783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:22:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3a14834c-f24c-4a42-9517-1a28f596f822 tempest-VolumesDeleteCascade-1370866783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:22:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3a14834c-f24c-4a42-9517-1a28f596f822 tempest-VolumesDeleteCascade-1370866783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:22:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3a14834c-f24c-4a42-9517-1a28f596f822 tempest-VolumesDeleteCascade-1370866783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:22:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3a14834c-f24c-4a42-9517-1a28f596f822 tempest-VolumesDeleteCascade-1370866783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:22:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3a14834c-f24c-4a42-9517-1a28f596f822 tempest-VolumesDeleteCascade-1370866783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:19 devstack sudo[91157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:22:19 devstack sudo[91157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:19 devstack sudo[91157]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3a14834c-f24c-4a42-9517-1a28f596f822 tempest-VolumesDeleteCascade-1370866783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.784s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:19 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-3a14834c-f24c-4a42-9517-1a28f596f822 tempest-VolumesDeleteCascade-1370866783 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:22:19 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-3a14834c-f24c-4a42-9517-1a28f596f822 tempest-VolumesDeleteCascade-1370866783 None] Deleted volume successfully. Apr 28 19:22:19 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3a14834c-f24c-4a42-9517-1a28f596f822 tempest-VolumesDeleteCascade-1370866783 None] Lock "cinder-99442fd1-817c-4bc2-a503-c6c0744b8b18-delete_volume" released by "delete_volume" :: held 2.659s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:22:21 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-44fc72e3-339b-48d6-8e78-3454c0b86893 tempest-VolumesListTestJSON-1569838124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:22:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-44fc72e3-339b-48d6-8e78-3454c0b86893 tempest-VolumesListTestJSON-1569838124 None] Flow 'volume_create_manager' (c73b495f-5b3d-4675-945f-c63951b65b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:22:22 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-44fc72e3-339b-48d6-8e78-3454c0b86893 tempest-VolumesListTestJSON-1569838124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06e25b04-38e7-44e8-943d-589c60b563b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:22 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-44fc72e3-339b-48d6-8e78-3454c0b86893 tempest-VolumesListTestJSON-1569838124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06e25b04-38e7-44e8-943d-589c60b563b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1035321552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a058054e-ef43-4d5f-9796-4bd98a97d051,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d85c2678e1d74f48a0e47d90c48b4277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:22:22Z,use_quota=True,user_id='b95f2434ef6a46d4843bb2c4307b3cb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:22 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-44fc72e3-339b-48d6-8e78-3454c0b86893 tempest-VolumesListTestJSON-1569838124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2343997f-c34f-4793-b721-714f989120f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:22 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-44fc72e3-339b-48d6-8e78-3454c0b86893 tempest-VolumesListTestJSON-1569838124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2343997f-c34f-4793-b721-714f989120f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:22 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-44fc72e3-339b-48d6-8e78-3454c0b86893 tempest-VolumesListTestJSON-1569838124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (835b435c-dd2a-4b6f-81af-225e989bd52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:22 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-44fc72e3-339b-48d6-8e78-3454c0b86893 tempest-VolumesListTestJSON-1569838124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (835b435c-dd2a-4b6f-81af-225e989bd52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a058054e-ef43-4d5f-9796-4bd98a97d051', 'volume_name': 'volume-a058054e-ef43-4d5f-9796-4bd98a97d051', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:22 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-44fc72e3-339b-48d6-8e78-3454c0b86893 tempest-VolumesListTestJSON-1569838124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b2275d4-d923-463c-8fc8-7e6443263108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:22 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-44fc72e3-339b-48d6-8e78-3454c0b86893 tempest-VolumesListTestJSON-1569838124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b2275d4-d923-463c-8fc8-7e6443263108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:22 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-44fc72e3-339b-48d6-8e78-3454c0b86893 tempest-VolumesListTestJSON-1569838124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4983144-792d-4a2e-958c-ef3674d3bc04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:22 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-44fc72e3-339b-48d6-8e78-3454c0b86893 tempest-VolumesListTestJSON-1569838124 None] Volume a058054e-ef43-4d5f-9796-4bd98a97d051: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a058054e-ef43-4d5f-9796-4bd98a97d051', 'volume_size': 1} Apr 28 19:22:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-44fc72e3-339b-48d6-8e78-3454c0b86893 tempest-VolumesListTestJSON-1569838124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:22:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-44fc72e3-339b-48d6-8e78-3454c0b86893 tempest-VolumesListTestJSON-1569838124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:22:22 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-44fc72e3-339b-48d6-8e78-3454c0b86893 tempest-VolumesListTestJSON-1569838124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1035321552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a058054e-ef43-4d5f-9796-4bd98a97d051,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d85c2678e1d74f48a0e47d90c48b4277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:22:22Z,use_quota=True,user_id='b95f2434ef6a46d4843bb2c4307b3cb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:22:22 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-44fc72e3-339b-48d6-8e78-3454c0b86893 tempest-VolumesListTestJSON-1569838124 None] Creating volume a058054e-ef43-4d5f-9796-4bd98a97d051 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:22:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-44fc72e3-339b-48d6-8e78-3454c0b86893 tempest-VolumesListTestJSON-1569838124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:22:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-44fc72e3-339b-48d6-8e78-3454c0b86893 tempest-VolumesListTestJSON-1569838124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:22:22 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-44fc72e3-339b-48d6-8e78-3454c0b86893 tempest-VolumesListTestJSON-1569838124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:22:22 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-44fc72e3-339b-48d6-8e78-3454c0b86893 tempest-VolumesListTestJSON-1569838124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:22:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-44fc72e3-339b-48d6-8e78-3454c0b86893 tempest-VolumesListTestJSON-1569838124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:22:22 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-44fc72e3-339b-48d6-8e78-3454c0b86893 tempest-VolumesListTestJSON-1569838124 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:22:22 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-44fc72e3-339b-48d6-8e78-3454c0b86893 tempest-VolumesListTestJSON-1569838124 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:22:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-44fc72e3-339b-48d6-8e78-3454c0b86893 tempest-VolumesListTestJSON-1569838124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a058054e-ef43-4d5f-9796-4bd98a97d051 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:22 devstack sudo[91161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a058054e-ef43-4d5f-9796-4bd98a97d051 1073741824 Apr 28 19:22:22 devstack sudo[91161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:22 devstack sudo[91161]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-44fc72e3-339b-48d6-8e78-3454c0b86893 tempest-VolumesListTestJSON-1569838124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a058054e-ef43-4d5f-9796-4bd98a97d051 1073741824" returned: 0 in 0.834s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-44fc72e3-339b-48d6-8e78-3454c0b86893 tempest-VolumesListTestJSON-1569838124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a058054e-ef43-4d5f-9796-4bd98a97d051 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:23 devstack sudo[91167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a058054e-ef43-4d5f-9796-4bd98a97d051 Apr 28 19:22:23 devstack sudo[91167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:23 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8fe8093-b12a-4fad-bf19-d328b35a6ccf tempest-VolumesMetadataTest-1179866951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:22:23 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a8fe8093-b12a-4fad-bf19-d328b35a6ccf tempest-VolumesMetadataTest-1179866951 None] Flow 'volume_create_manager' (738414d6-cd4f-4c5b-9d60-e9759540ff29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:22:23 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a8fe8093-b12a-4fad-bf19-d328b35a6ccf tempest-VolumesMetadataTest-1179866951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff2b57dd-a311-402b-a5c5-cc38350fdd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:23 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a8fe8093-b12a-4fad-bf19-d328b35a6ccf tempest-VolumesMetadataTest-1179866951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff2b57dd-a311-402b-a5c5-cc38350fdd9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-677637119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=379bcd28-e10f-4b5e-90a4-a8b5861d9138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bfba984390a40bda5ef70f440655864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:22:23Z,use_quota=True,user_id='593f472b28764744946786a406090fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:23 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a8fe8093-b12a-4fad-bf19-d328b35a6ccf tempest-VolumesMetadataTest-1179866951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aafc3452-28ba-4230-acdf-ce8b14988a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:23 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a8fe8093-b12a-4fad-bf19-d328b35a6ccf tempest-VolumesMetadataTest-1179866951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aafc3452-28ba-4230-acdf-ce8b14988a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:23 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a8fe8093-b12a-4fad-bf19-d328b35a6ccf tempest-VolumesMetadataTest-1179866951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63db4891-2376-4407-83bd-e92bea8f7349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:23 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a8fe8093-b12a-4fad-bf19-d328b35a6ccf tempest-VolumesMetadataTest-1179866951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63db4891-2376-4407-83bd-e92bea8f7349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '379bcd28-e10f-4b5e-90a4-a8b5861d9138', 'volume_name': 'volume-379bcd28-e10f-4b5e-90a4-a8b5861d9138', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:23 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a8fe8093-b12a-4fad-bf19-d328b35a6ccf tempest-VolumesMetadataTest-1179866951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e80cec3-9495-471b-b405-862ac601a959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:23 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a8fe8093-b12a-4fad-bf19-d328b35a6ccf tempest-VolumesMetadataTest-1179866951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e80cec3-9495-471b-b405-862ac601a959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:23 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a8fe8093-b12a-4fad-bf19-d328b35a6ccf tempest-VolumesMetadataTest-1179866951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f28626ef-4444-4431-86de-8bf915f97e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:23 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-a8fe8093-b12a-4fad-bf19-d328b35a6ccf tempest-VolumesMetadataTest-1179866951 None] Volume 379bcd28-e10f-4b5e-90a4-a8b5861d9138: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-379bcd28-e10f-4b5e-90a4-a8b5861d9138', 'volume_size': 1} Apr 28 19:22:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a8fe8093-b12a-4fad-bf19-d328b35a6ccf tempest-VolumesMetadataTest-1179866951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:22:23 devstack sudo[91167]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-44fc72e3-339b-48d6-8e78-3454c0b86893 tempest-VolumesListTestJSON-1569838124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a058054e-ef43-4d5f-9796-4bd98a97d051" returned: 0 in 0.694s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:23 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-44fc72e3-339b-48d6-8e78-3454c0b86893 tempest-VolumesListTestJSON-1569838124 None] <== create_volume: return (1593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:22:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-44fc72e3-339b-48d6-8e78-3454c0b86893 tempest-VolumesListTestJSON-1569838124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:22:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a8fe8093-b12a-4fad-bf19-d328b35a6ccf tempest-VolumesMetadataTest-1179866951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.314s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:22:23 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a8fe8093-b12a-4fad-bf19-d328b35a6ccf tempest-VolumesMetadataTest-1179866951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-677637119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=379bcd28-e10f-4b5e-90a4-a8b5861d9138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bfba984390a40bda5ef70f440655864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:22:23Z,use_quota=True,user_id='593f472b28764744946786a406090fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:22:23 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-a8fe8093-b12a-4fad-bf19-d328b35a6ccf tempest-VolumesMetadataTest-1179866951 None] Creating volume 379bcd28-e10f-4b5e-90a4-a8b5861d9138 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:22:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a8fe8093-b12a-4fad-bf19-d328b35a6ccf tempest-VolumesMetadataTest-1179866951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:22:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a8fe8093-b12a-4fad-bf19-d328b35a6ccf tempest-VolumesMetadataTest-1179866951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:22:23 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a8fe8093-b12a-4fad-bf19-d328b35a6ccf tempest-VolumesMetadataTest-1179866951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:22:23 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a8fe8093-b12a-4fad-bf19-d328b35a6ccf tempest-VolumesMetadataTest-1179866951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:22:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a8fe8093-b12a-4fad-bf19-d328b35a6ccf tempest-VolumesMetadataTest-1179866951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:22:23 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a8fe8093-b12a-4fad-bf19-d328b35a6ccf tempest-VolumesMetadataTest-1179866951 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:22:23 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-a8fe8093-b12a-4fad-bf19-d328b35a6ccf tempest-VolumesMetadataTest-1179866951 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:22:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a8fe8093-b12a-4fad-bf19-d328b35a6ccf tempest-VolumesMetadataTest-1179866951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-379bcd28-e10f-4b5e-90a4-a8b5861d9138 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:23 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-44fc72e3-339b-48d6-8e78-3454c0b86893 tempest-VolumesListTestJSON-1569838124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4983144-792d-4a2e-958c-ef3674d3bc04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a058054e-ef43-4d5f-9796-4bd98a97d051', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:23 devstack sudo[91170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-379bcd28-e10f-4b5e-90a4-a8b5861d9138 1073741824 Apr 28 19:22:23 devstack sudo[91170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:23 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-44fc72e3-339b-48d6-8e78-3454c0b86893 tempest-VolumesListTestJSON-1569838124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e72d1679-daef-4171-b7bb-53e30477c1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:23 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-44fc72e3-339b-48d6-8e78-3454c0b86893 tempest-VolumesListTestJSON-1569838124 None] Volume volume-a058054e-ef43-4d5f-9796-4bd98a97d051 (a058054e-ef43-4d5f-9796-4bd98a97d051): created successfully Apr 28 19:22:23 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-44fc72e3-339b-48d6-8e78-3454c0b86893 tempest-VolumesListTestJSON-1569838124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e72d1679-daef-4171-b7bb-53e30477c1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:23 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-44fc72e3-339b-48d6-8e78-3454c0b86893 tempest-VolumesListTestJSON-1569838124 None] Flow 'volume_create_manager' (c73b495f-5b3d-4675-945f-c63951b65b58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:22:23 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-44fc72e3-339b-48d6-8e78-3454c0b86893 tempest-VolumesListTestJSON-1569838124 None] Created volume successfully. Apr 28 19:22:24 devstack sudo[91170]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:24 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-535443bb-2646-4a63-be46-a1509bb8941b tempest-VolumesListTestJSON-1569838124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:22:24 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-535443bb-2646-4a63-be46-a1509bb8941b tempest-VolumesListTestJSON-1569838124 None] Flow 'volume_create_manager' (638e8a45-a85b-460b-823c-75ed7e109f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:22:24 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-535443bb-2646-4a63-be46-a1509bb8941b tempest-VolumesListTestJSON-1569838124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d606aa0-3fe2-4165-a8d7-e2ec5d85fc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a8fe8093-b12a-4fad-bf19-d328b35a6ccf tempest-VolumesMetadataTest-1179866951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-379bcd28-e10f-4b5e-90a4-a8b5861d9138 1073741824" returned: 0 in 1.001s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:24 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-535443bb-2646-4a63-be46-a1509bb8941b tempest-VolumesListTestJSON-1569838124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d606aa0-3fe2-4165-a8d7-e2ec5d85fc0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-54908537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5adc22ac-45a7-467d-982c-6b624e9af7bd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d85c2678e1d74f48a0e47d90c48b4277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:22:25Z,use_quota=True,user_id='b95f2434ef6a46d4843bb2c4307b3cb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:24 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-535443bb-2646-4a63-be46-a1509bb8941b tempest-VolumesListTestJSON-1569838124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (122543db-0204-42df-be6a-8d54486678b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:24 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-535443bb-2646-4a63-be46-a1509bb8941b tempest-VolumesListTestJSON-1569838124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (122543db-0204-42df-be6a-8d54486678b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:24 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-535443bb-2646-4a63-be46-a1509bb8941b tempest-VolumesListTestJSON-1569838124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af8ab311-e4b1-4488-9476-34596955bd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:24 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-535443bb-2646-4a63-be46-a1509bb8941b tempest-VolumesListTestJSON-1569838124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af8ab311-e4b1-4488-9476-34596955bd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5adc22ac-45a7-467d-982c-6b624e9af7bd', 'volume_name': 'volume-5adc22ac-45a7-467d-982c-6b624e9af7bd', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:24 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-535443bb-2646-4a63-be46-a1509bb8941b tempest-VolumesListTestJSON-1569838124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab68c962-6447-40a6-ba8e-37fb57e7ffee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:24 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-535443bb-2646-4a63-be46-a1509bb8941b tempest-VolumesListTestJSON-1569838124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab68c962-6447-40a6-ba8e-37fb57e7ffee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:24 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-535443bb-2646-4a63-be46-a1509bb8941b tempest-VolumesListTestJSON-1569838124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c64f337-5905-4cc6-8749-7f8dde87432e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:24 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-535443bb-2646-4a63-be46-a1509bb8941b tempest-VolumesListTestJSON-1569838124 None] Volume 5adc22ac-45a7-467d-982c-6b624e9af7bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5adc22ac-45a7-467d-982c-6b624e9af7bd', 'volume_size': 1} Apr 28 19:22:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-535443bb-2646-4a63-be46-a1509bb8941b tempest-VolumesListTestJSON-1569838124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:22:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a8fe8093-b12a-4fad-bf19-d328b35a6ccf tempest-VolumesMetadataTest-1179866951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-379bcd28-e10f-4b5e-90a4-a8b5861d9138 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:24 devstack sudo[91175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-379bcd28-e10f-4b5e-90a4-a8b5861d9138 Apr 28 19:22:24 devstack sudo[91175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:25 devstack sudo[91175]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a8fe8093-b12a-4fad-bf19-d328b35a6ccf tempest-VolumesMetadataTest-1179866951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-379bcd28-e10f-4b5e-90a4-a8b5861d9138" returned: 0 in 0.634s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a8fe8093-b12a-4fad-bf19-d328b35a6ccf tempest-VolumesMetadataTest-1179866951 None] <== create_volume: return (1726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:22:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a8fe8093-b12a-4fad-bf19-d328b35a6ccf tempest-VolumesMetadataTest-1179866951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:22:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-535443bb-2646-4a63-be46-a1509bb8941b tempest-VolumesListTestJSON-1569838124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.663s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:22:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-535443bb-2646-4a63-be46-a1509bb8941b tempest-VolumesListTestJSON-1569838124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-54908537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5adc22ac-45a7-467d-982c-6b624e9af7bd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d85c2678e1d74f48a0e47d90c48b4277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:22:25Z,use_quota=True,user_id='b95f2434ef6a46d4843bb2c4307b3cb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:22:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-535443bb-2646-4a63-be46-a1509bb8941b tempest-VolumesListTestJSON-1569838124 None] Creating volume 5adc22ac-45a7-467d-982c-6b624e9af7bd {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:22:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-535443bb-2646-4a63-be46-a1509bb8941b tempest-VolumesListTestJSON-1569838124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:22:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-535443bb-2646-4a63-be46-a1509bb8941b tempest-VolumesListTestJSON-1569838124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:22:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-535443bb-2646-4a63-be46-a1509bb8941b tempest-VolumesListTestJSON-1569838124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:22:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-535443bb-2646-4a63-be46-a1509bb8941b tempest-VolumesListTestJSON-1569838124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:22:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-535443bb-2646-4a63-be46-a1509bb8941b tempest-VolumesListTestJSON-1569838124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:22:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-535443bb-2646-4a63-be46-a1509bb8941b tempest-VolumesListTestJSON-1569838124 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:22:25 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-535443bb-2646-4a63-be46-a1509bb8941b tempest-VolumesListTestJSON-1569838124 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:22:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-535443bb-2646-4a63-be46-a1509bb8941b tempest-VolumesListTestJSON-1569838124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5adc22ac-45a7-467d-982c-6b624e9af7bd 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a8fe8093-b12a-4fad-bf19-d328b35a6ccf tempest-VolumesMetadataTest-1179866951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f28626ef-4444-4431-86de-8bf915f97e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-379bcd28-e10f-4b5e-90a4-a8b5861d9138', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:25 devstack sudo[91178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5adc22ac-45a7-467d-982c-6b624e9af7bd 1073741824 Apr 28 19:22:25 devstack sudo[91178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a8fe8093-b12a-4fad-bf19-d328b35a6ccf tempest-VolumesMetadataTest-1179866951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2293c2b6-0ab7-4194-896c-fcd55432fb9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:25 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-a8fe8093-b12a-4fad-bf19-d328b35a6ccf tempest-VolumesMetadataTest-1179866951 None] Volume volume-379bcd28-e10f-4b5e-90a4-a8b5861d9138 (379bcd28-e10f-4b5e-90a4-a8b5861d9138): created successfully Apr 28 19:22:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a8fe8093-b12a-4fad-bf19-d328b35a6ccf tempest-VolumesMetadataTest-1179866951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2293c2b6-0ab7-4194-896c-fcd55432fb9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a8fe8093-b12a-4fad-bf19-d328b35a6ccf tempest-VolumesMetadataTest-1179866951 None] Flow 'volume_create_manager' (738414d6-cd4f-4c5b-9d60-e9759540ff29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:22:25 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-a8fe8093-b12a-4fad-bf19-d328b35a6ccf tempest-VolumesMetadataTest-1179866951 None] Created volume successfully. Apr 28 19:22:26 devstack sudo[91178]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-535443bb-2646-4a63-be46-a1509bb8941b tempest-VolumesListTestJSON-1569838124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5adc22ac-45a7-467d-982c-6b624e9af7bd 1073741824" returned: 0 in 0.861s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-535443bb-2646-4a63-be46-a1509bb8941b tempest-VolumesListTestJSON-1569838124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5adc22ac-45a7-467d-982c-6b624e9af7bd {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:26 devstack sudo[91184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5adc22ac-45a7-467d-982c-6b624e9af7bd Apr 28 19:22:26 devstack sudo[91184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:26 devstack sudo[91184]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-535443bb-2646-4a63-be46-a1509bb8941b tempest-VolumesListTestJSON-1569838124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5adc22ac-45a7-467d-982c-6b624e9af7bd" returned: 0 in 0.630s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:26 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-535443bb-2646-4a63-be46-a1509bb8941b tempest-VolumesListTestJSON-1569838124 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:22:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-535443bb-2646-4a63-be46-a1509bb8941b tempest-VolumesListTestJSON-1569838124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:22:26 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-535443bb-2646-4a63-be46-a1509bb8941b tempest-VolumesListTestJSON-1569838124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c64f337-5905-4cc6-8749-7f8dde87432e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5adc22ac-45a7-467d-982c-6b624e9af7bd', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:26 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-535443bb-2646-4a63-be46-a1509bb8941b tempest-VolumesListTestJSON-1569838124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23e0383f-1f7a-4c11-a219-80a16bb4547f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:26 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-535443bb-2646-4a63-be46-a1509bb8941b tempest-VolumesListTestJSON-1569838124 None] Volume volume-5adc22ac-45a7-467d-982c-6b624e9af7bd (5adc22ac-45a7-467d-982c-6b624e9af7bd): created successfully Apr 28 19:22:26 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-535443bb-2646-4a63-be46-a1509bb8941b tempest-VolumesListTestJSON-1569838124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23e0383f-1f7a-4c11-a219-80a16bb4547f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:26 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-535443bb-2646-4a63-be46-a1509bb8941b tempest-VolumesListTestJSON-1569838124 None] Flow 'volume_create_manager' (638e8a45-a85b-460b-823c-75ed7e109f1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:22:27 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-535443bb-2646-4a63-be46-a1509bb8941b tempest-VolumesListTestJSON-1569838124 None] Created volume successfully. Apr 28 19:22:27 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-dd22dede-5f47-4c8d-b76b-4a6cca1baa3e tempest-VolumesMetadataTest-1179866951 None] Acquiring lock "cinder-379bcd28-e10f-4b5e-90a4-a8b5861d9138-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:22:27 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-dd22dede-5f47-4c8d-b76b-4a6cca1baa3e tempest-VolumesMetadataTest-1179866951 None] Lock "cinder-379bcd28-e10f-4b5e-90a4-a8b5861d9138-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:22:27 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-dd22dede-5f47-4c8d-b76b-4a6cca1baa3e tempest-VolumesMetadataTest-1179866951 None] Acquiring lock "cinder-quobyte-379bcd28-e10f-4b5e-90a4-a8b5861d9138" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:22:27 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-dd22dede-5f47-4c8d-b76b-4a6cca1baa3e tempest-VolumesMetadataTest-1179866951 None] Lock "cinder-quobyte-379bcd28-e10f-4b5e-90a4-a8b5861d9138" acquired by "delete_volume" :: waited 0.017s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:22:27 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af73ab7-c38c-4e01-8d19-bd6ed8fc7fcc]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:22:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-dd22dede-5f47-4c8d-b76b-4a6cca1baa3e tempest-VolumesMetadataTest-1179866951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-379bcd28-e10f-4b5e-90a4-a8b5861d9138 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:27 devstack sudo[91187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-379bcd28-e10f-4b5e-90a4-a8b5861d9138 Apr 28 19:22:27 devstack sudo[91187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:28 devstack sudo[91187]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-dd22dede-5f47-4c8d-b76b-4a6cca1baa3e tempest-VolumesMetadataTest-1179866951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-379bcd28-e10f-4b5e-90a4-a8b5861d9138" returned: 0 in 0.766s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-dd22dede-5f47-4c8d-b76b-4a6cca1baa3e tempest-VolumesMetadataTest-1179866951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-379bcd28-e10f-4b5e-90a4-a8b5861d9138 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:28 devstack sudo[91192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-379bcd28-e10f-4b5e-90a4-a8b5861d9138 Apr 28 19:22:28 devstack sudo[91192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:28 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7067859-ef0c-4861-9b97-b745cd718396 tempest-VolumesListTestJSON-1569838124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:22:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a7067859-ef0c-4861-9b97-b745cd718396 tempest-VolumesListTestJSON-1569838124 None] Flow 'volume_create_manager' (05895452-fe53-427f-98ee-bee9373c65f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:22:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a7067859-ef0c-4861-9b97-b745cd718396 tempest-VolumesListTestJSON-1569838124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1340325d-36b9-450d-bd1b-1d268954d111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a7067859-ef0c-4861-9b97-b745cd718396 tempest-VolumesListTestJSON-1569838124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1340325d-36b9-450d-bd1b-1d268954d111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1704006561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4cbb7b7-b2f2-4095-873b-7533f1f46fe5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d85c2678e1d74f48a0e47d90c48b4277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:22:28Z,use_quota=True,user_id='b95f2434ef6a46d4843bb2c4307b3cb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a7067859-ef0c-4861-9b97-b745cd718396 tempest-VolumesListTestJSON-1569838124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ff3739c-e5cc-42e7-8ca8-e097720a8f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a7067859-ef0c-4861-9b97-b745cd718396 tempest-VolumesListTestJSON-1569838124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ff3739c-e5cc-42e7-8ca8-e097720a8f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a7067859-ef0c-4861-9b97-b745cd718396 tempest-VolumesListTestJSON-1569838124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9abd224c-5e47-4a53-9ad4-a11c26edbea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a7067859-ef0c-4861-9b97-b745cd718396 tempest-VolumesListTestJSON-1569838124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9abd224c-5e47-4a53-9ad4-a11c26edbea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4cbb7b7-b2f2-4095-873b-7533f1f46fe5', 'volume_name': 'volume-d4cbb7b7-b2f2-4095-873b-7533f1f46fe5', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a7067859-ef0c-4861-9b97-b745cd718396 tempest-VolumesListTestJSON-1569838124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86201afb-bc7b-40fb-9d2b-e57ef3fc60e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a7067859-ef0c-4861-9b97-b745cd718396 tempest-VolumesListTestJSON-1569838124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86201afb-bc7b-40fb-9d2b-e57ef3fc60e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a7067859-ef0c-4861-9b97-b745cd718396 tempest-VolumesListTestJSON-1569838124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15d142a9-323a-4642-add5-6d5547467ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:28 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-a7067859-ef0c-4861-9b97-b745cd718396 tempest-VolumesListTestJSON-1569838124 None] Volume d4cbb7b7-b2f2-4095-873b-7533f1f46fe5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4cbb7b7-b2f2-4095-873b-7533f1f46fe5', 'volume_size': 1} Apr 28 19:22:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a7067859-ef0c-4861-9b97-b745cd718396 tempest-VolumesListTestJSON-1569838124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:22:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a7067859-ef0c-4861-9b97-b745cd718396 tempest-VolumesListTestJSON-1569838124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:22:28 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a7067859-ef0c-4861-9b97-b745cd718396 tempest-VolumesListTestJSON-1569838124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1704006561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4cbb7b7-b2f2-4095-873b-7533f1f46fe5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d85c2678e1d74f48a0e47d90c48b4277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:22:28Z,use_quota=True,user_id='b95f2434ef6a46d4843bb2c4307b3cb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:22:28 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-a7067859-ef0c-4861-9b97-b745cd718396 tempest-VolumesListTestJSON-1569838124 None] Creating volume d4cbb7b7-b2f2-4095-873b-7533f1f46fe5 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:22:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a7067859-ef0c-4861-9b97-b745cd718396 tempest-VolumesListTestJSON-1569838124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:22:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a7067859-ef0c-4861-9b97-b745cd718396 tempest-VolumesListTestJSON-1569838124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:22:28 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a7067859-ef0c-4861-9b97-b745cd718396 tempest-VolumesListTestJSON-1569838124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:22:28 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a7067859-ef0c-4861-9b97-b745cd718396 tempest-VolumesListTestJSON-1569838124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:22:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a7067859-ef0c-4861-9b97-b745cd718396 tempest-VolumesListTestJSON-1569838124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:22:28 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a7067859-ef0c-4861-9b97-b745cd718396 tempest-VolumesListTestJSON-1569838124 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:22:28 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-a7067859-ef0c-4861-9b97-b745cd718396 tempest-VolumesListTestJSON-1569838124 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:22:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a7067859-ef0c-4861-9b97-b745cd718396 tempest-VolumesListTestJSON-1569838124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d4cbb7b7-b2f2-4095-873b-7533f1f46fe5 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:28 devstack sudo[91194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d4cbb7b7-b2f2-4095-873b-7533f1f46fe5 1073741824 Apr 28 19:22:28 devstack sudo[91194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:28 devstack sudo[91192]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-dd22dede-5f47-4c8d-b76b-4a6cca1baa3e tempest-VolumesMetadataTest-1179866951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-379bcd28-e10f-4b5e-90a4-a8b5861d9138" returned: 0 in 0.678s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:28 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-dd22dede-5f47-4c8d-b76b-4a6cca1baa3e tempest-VolumesMetadataTest-1179866951 None] Lock "cinder-quobyte-379bcd28-e10f-4b5e-90a4-a8b5861d9138" released by "delete_volume" :: held 1.492s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:22:28 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-dd22dede-5f47-4c8d-b76b-4a6cca1baa3e tempest-VolumesMetadataTest-1179866951 None] Created reservations ['c4757655-e7ed-4af4-8b37-02f94930bbf1', 'e2d52494-2ab8-4027-b4ae-480f262ff90c', '20d0c37c-1c25-48e0-8473-d0ec62c64aee', '9270c1eb-a9df-4e91-94e1-ffdb245f91b7'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:22:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-dd22dede-5f47-4c8d-b76b-4a6cca1baa3e tempest-VolumesMetadataTest-1179866951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:22:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-dd22dede-5f47-4c8d-b76b-4a6cca1baa3e tempest-VolumesMetadataTest-1179866951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:22:28 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-dd22dede-5f47-4c8d-b76b-4a6cca1baa3e tempest-VolumesMetadataTest-1179866951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:22:28 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-dd22dede-5f47-4c8d-b76b-4a6cca1baa3e tempest-VolumesMetadataTest-1179866951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:22:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-dd22dede-5f47-4c8d-b76b-4a6cca1baa3e tempest-VolumesMetadataTest-1179866951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:22:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-dd22dede-5f47-4c8d-b76b-4a6cca1baa3e tempest-VolumesMetadataTest-1179866951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:28 devstack sudo[91197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:22:28 devstack sudo[91197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:29 devstack sudo[91194]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a7067859-ef0c-4861-9b97-b745cd718396 tempest-VolumesListTestJSON-1569838124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d4cbb7b7-b2f2-4095-873b-7533f1f46fe5 1073741824" returned: 0 in 0.889s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a7067859-ef0c-4861-9b97-b745cd718396 tempest-VolumesListTestJSON-1569838124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d4cbb7b7-b2f2-4095-873b-7533f1f46fe5 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:29 devstack sudo[91202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d4cbb7b7-b2f2-4095-873b-7533f1f46fe5 Apr 28 19:22:29 devstack sudo[91202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:29 devstack sudo[91197]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-dd22dede-5f47-4c8d-b76b-4a6cca1baa3e tempest-VolumesMetadataTest-1179866951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.683s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:29 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-dd22dede-5f47-4c8d-b76b-4a6cca1baa3e tempest-VolumesMetadataTest-1179866951 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:22:29 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-dd22dede-5f47-4c8d-b76b-4a6cca1baa3e tempest-VolumesMetadataTest-1179866951 None] Deleted volume successfully. Apr 28 19:22:29 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-dd22dede-5f47-4c8d-b76b-4a6cca1baa3e tempest-VolumesMetadataTest-1179866951 None] Lock "cinder-379bcd28-e10f-4b5e-90a4-a8b5861d9138-delete_volume" released by "delete_volume" :: held 2.434s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:22:30 devstack sudo[91202]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a7067859-ef0c-4861-9b97-b745cd718396 tempest-VolumesListTestJSON-1569838124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d4cbb7b7-b2f2-4095-873b-7533f1f46fe5" returned: 0 in 0.691s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:30 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a7067859-ef0c-4861-9b97-b745cd718396 tempest-VolumesListTestJSON-1569838124 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:22:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a7067859-ef0c-4861-9b97-b745cd718396 tempest-VolumesListTestJSON-1569838124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:22:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a7067859-ef0c-4861-9b97-b745cd718396 tempest-VolumesListTestJSON-1569838124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15d142a9-323a-4642-add5-6d5547467ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4cbb7b7-b2f2-4095-873b-7533f1f46fe5', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a7067859-ef0c-4861-9b97-b745cd718396 tempest-VolumesListTestJSON-1569838124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ded8e65-f69b-4ccf-9d96-e623ba44ef45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:30 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-a7067859-ef0c-4861-9b97-b745cd718396 tempest-VolumesListTestJSON-1569838124 None] Volume volume-d4cbb7b7-b2f2-4095-873b-7533f1f46fe5 (d4cbb7b7-b2f2-4095-873b-7533f1f46fe5): created successfully Apr 28 19:22:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a7067859-ef0c-4861-9b97-b745cd718396 tempest-VolumesListTestJSON-1569838124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ded8e65-f69b-4ccf-9d96-e623ba44ef45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a7067859-ef0c-4861-9b97-b745cd718396 tempest-VolumesListTestJSON-1569838124 None] Flow 'volume_create_manager' (05895452-fe53-427f-98ee-bee9373c65f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:22:30 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-a7067859-ef0c-4861-9b97-b745cd718396 tempest-VolumesListTestJSON-1569838124 None] Created volume successfully. Apr 28 19:22:32 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d9aa65f9-e975-4c44-9449-90dbdbd54664 tempest-VolumesListTestJSON-1569838124 None] Acquiring lock "cinder-d4cbb7b7-b2f2-4095-873b-7533f1f46fe5-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:22:32 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d9aa65f9-e975-4c44-9449-90dbdbd54664 tempest-VolumesListTestJSON-1569838124 None] Lock "cinder-d4cbb7b7-b2f2-4095-873b-7533f1f46fe5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:22:32 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d9aa65f9-e975-4c44-9449-90dbdbd54664 tempest-VolumesListTestJSON-1569838124 None] Acquiring lock "cinder-quobyte-d4cbb7b7-b2f2-4095-873b-7533f1f46fe5" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:22:33 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d9aa65f9-e975-4c44-9449-90dbdbd54664 tempest-VolumesListTestJSON-1569838124 None] Lock "cinder-quobyte-d4cbb7b7-b2f2-4095-873b-7533f1f46fe5" acquired by "delete_volume" :: waited 0.019s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:22:33 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc10364-98cb-4d30-9340-038bfa9cb4bf]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:22:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d9aa65f9-e975-4c44-9449-90dbdbd54664 tempest-VolumesListTestJSON-1569838124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d4cbb7b7-b2f2-4095-873b-7533f1f46fe5 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:33 devstack sudo[91207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d4cbb7b7-b2f2-4095-873b-7533f1f46fe5 Apr 28 19:22:33 devstack sudo[91207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:33 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:22:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Flow 'volume_create_manager' (614ac311-d926-4ec6-9a2e-76c23cda8b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:22:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc0af3a4-ea10-420d-ba88-66e9e529f306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc0af3a4-ea10-420d-ba88-66e9e529f306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1728708495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66308b20-5e26-4941-a42b-3d710390a7cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b853b9048bad42c38d178784b365495e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:22:33Z,use_quota=True,user_id='26f78cf3cb46486e8dceaf5de4247cab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ecb0d91-2b4b-4b02-ba5c-fc3efccaa1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ecb0d91-2b4b-4b02-ba5c-fc3efccaa1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9ccaa46-34f0-4d96-b193-e7571baa12b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:33 devstack cinder-volume[83863]: DEBUG cinder.image.glance [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Creating Keystone auth plugin from conf {{(pid=83863) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 28 19:22:33 devstack sudo[91207]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d9aa65f9-e975-4c44-9449-90dbdbd54664 tempest-VolumesListTestJSON-1569838124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d4cbb7b7-b2f2-4095-873b-7533f1f46fe5" returned: 0 in 0.832s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d9aa65f9-e975-4c44-9449-90dbdbd54664 tempest-VolumesListTestJSON-1569838124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d4cbb7b7-b2f2-4095-873b-7533f1f46fe5 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:33 devstack sudo[91213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d4cbb7b7-b2f2-4095-873b-7533f1f46fe5 Apr 28 19:22:33 devstack sudo[91213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9ccaa46-34f0-4d96-b193-e7571baa12b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '66308b20-5e26-4941-a42b-3d710390a7cc', 'volume_name': 'volume-66308b20-5e26-4941-a42b-3d710390a7cc', 'volume_size': 1, 'image_id': 'd11adb91-6b52-452f-a796-9ef8412183bf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d11adb91-6b52-452f-a796-9ef8412183bf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6469daf89505401a8582e1f501a60d80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd11adb91-6b52-452f-a796-9ef8412183bf', 'created_at': datetime.datetime(2026, 4, 28, 17, 9, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 17, 9, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d11adb91-6b52-452f-a796-9ef8412183bf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a6b87ab-3c8c-4a35-8130-3b896e626497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a6b87ab-3c8c-4a35-8130-3b896e626497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6c3008f-17d4-4782-8e7f-c25d07f30319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:33 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Volume 66308b20-5e26-4941-a42b-3d710390a7cc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-66308b20-5e26-4941-a42b-3d710390a7cc', 'volume_size': 1, 'image_id': 'd11adb91-6b52-452f-a796-9ef8412183bf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d11adb91-6b52-452f-a796-9ef8412183bf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6469daf89505401a8582e1f501a60d80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd11adb91-6b52-452f-a796-9ef8412183bf', 'created_at': datetime.datetime(2026, 4, 28, 17, 9, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 17, 9, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d11adb91-6b52-452f-a796-9ef8412183bf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 28 19:22:33 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Trying to clone 66308b20-5e26-4941-a42b-3d710390a7cc from image d11adb91-6b52-452f-a796-9ef8412183bf at location (None, [{'url': 'file:///opt/stack/data/glance/images/d11adb91-6b52-452f-a796-9ef8412183bf', 'metadata': {}}]). {{(pid=83863) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Apr 28 19:22:34 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_ijrdtnd6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83863) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 28 19:22:34 devstack cinder-volume[83863]: INFO cinder.image.image_utils [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Image download 20.69 MB at 20.69 MB/s Apr 28 19:22:34 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[33518d52-6502-4c51-ae7d-b2c2f920ce60]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:22:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_ijrdtnd6devstack@QuobyteHD {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:34 devstack sudo[91216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_ijrdtnd6devstack@QuobyteHD Apr 28 19:22:34 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e32f322-b94d-4296-b283-24846a4e7322 tempest-VolumesTransfersTest-881705135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:22:34 devstack sudo[91216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9e32f322-b94d-4296-b283-24846a4e7322 tempest-VolumesTransfersTest-881705135 None] Flow 'volume_create_manager' (8c2a2032-afe3-447b-841b-9180226f0d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:22:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9e32f322-b94d-4296-b283-24846a4e7322 tempest-VolumesTransfersTest-881705135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f2e8e5f-b95f-4c6e-affd-200e2eb84830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9e32f322-b94d-4296-b283-24846a4e7322 tempest-VolumesTransfersTest-881705135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f2e8e5f-b95f-4c6e-affd-200e2eb84830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-987360014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe5e5865-3a3f-470f-8cb7-4ace045a5def,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c1a1c35fa04a189b932eb0a8d40830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:22:35Z,use_quota=True,user_id='512a881b31ad4e3c953a7e757e955032',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9e32f322-b94d-4296-b283-24846a4e7322 tempest-VolumesTransfersTest-881705135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43a8de48-40e5-45b1-a3fa-4a02f5522fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9e32f322-b94d-4296-b283-24846a4e7322 tempest-VolumesTransfersTest-881705135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43a8de48-40e5-45b1-a3fa-4a02f5522fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9e32f322-b94d-4296-b283-24846a4e7322 tempest-VolumesTransfersTest-881705135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2814ec9e-bb77-4f9d-b5e8-adccc271029d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9e32f322-b94d-4296-b283-24846a4e7322 tempest-VolumesTransfersTest-881705135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2814ec9e-bb77-4f9d-b5e8-adccc271029d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe5e5865-3a3f-470f-8cb7-4ace045a5def', 'volume_name': 'volume-fe5e5865-3a3f-470f-8cb7-4ace045a5def', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9e32f322-b94d-4296-b283-24846a4e7322 tempest-VolumesTransfersTest-881705135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10090e1c-4ad4-4724-8c34-ff0b41ef10dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9e32f322-b94d-4296-b283-24846a4e7322 tempest-VolumesTransfersTest-881705135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10090e1c-4ad4-4724-8c34-ff0b41ef10dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9e32f322-b94d-4296-b283-24846a4e7322 tempest-VolumesTransfersTest-881705135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b63093af-7816-4185-ac53-bf8460d8ebf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:34 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-9e32f322-b94d-4296-b283-24846a4e7322 tempest-VolumesTransfersTest-881705135 None] Volume fe5e5865-3a3f-470f-8cb7-4ace045a5def: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe5e5865-3a3f-470f-8cb7-4ace045a5def', 'volume_size': 1} Apr 28 19:22:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9e32f322-b94d-4296-b283-24846a4e7322 tempest-VolumesTransfersTest-881705135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:22:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9e32f322-b94d-4296-b283-24846a4e7322 tempest-VolumesTransfersTest-881705135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:22:34 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-9e32f322-b94d-4296-b283-24846a4e7322 tempest-VolumesTransfersTest-881705135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-987360014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe5e5865-3a3f-470f-8cb7-4ace045a5def,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c1a1c35fa04a189b932eb0a8d40830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:22:35Z,use_quota=True,user_id='512a881b31ad4e3c953a7e757e955032',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:22:34 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-9e32f322-b94d-4296-b283-24846a4e7322 tempest-VolumesTransfersTest-881705135 None] Creating volume fe5e5865-3a3f-470f-8cb7-4ace045a5def {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:22:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9e32f322-b94d-4296-b283-24846a4e7322 tempest-VolumesTransfersTest-881705135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:22:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9e32f322-b94d-4296-b283-24846a4e7322 tempest-VolumesTransfersTest-881705135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:22:34 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-9e32f322-b94d-4296-b283-24846a4e7322 tempest-VolumesTransfersTest-881705135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:22:34 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-9e32f322-b94d-4296-b283-24846a4e7322 tempest-VolumesTransfersTest-881705135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:22:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9e32f322-b94d-4296-b283-24846a4e7322 tempest-VolumesTransfersTest-881705135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:22:34 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-9e32f322-b94d-4296-b283-24846a4e7322 tempest-VolumesTransfersTest-881705135 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:22:34 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-9e32f322-b94d-4296-b283-24846a4e7322 tempest-VolumesTransfersTest-881705135 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:22:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9e32f322-b94d-4296-b283-24846a4e7322 tempest-VolumesTransfersTest-881705135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fe5e5865-3a3f-470f-8cb7-4ace045a5def 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:34 devstack sudo[91213]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:34 devstack sudo[91219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fe5e5865-3a3f-470f-8cb7-4ace045a5def 1073741824 Apr 28 19:22:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d9aa65f9-e975-4c44-9449-90dbdbd54664 tempest-VolumesListTestJSON-1569838124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d4cbb7b7-b2f2-4095-873b-7533f1f46fe5" returned: 0 in 0.852s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:34 devstack sudo[91219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:34 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d9aa65f9-e975-4c44-9449-90dbdbd54664 tempest-VolumesListTestJSON-1569838124 None] Lock "cinder-quobyte-d4cbb7b7-b2f2-4095-873b-7533f1f46fe5" released by "delete_volume" :: held 1.748s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:22:34 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-d9aa65f9-e975-4c44-9449-90dbdbd54664 tempest-VolumesListTestJSON-1569838124 None] Created reservations ['dcecd347-a6f0-4052-b7b4-c91ea9ed0d15', '12e81eaf-d5e3-4f42-978c-3b2373fca13c', '4cb14c83-b8bc-4d83-a490-8b256c47f251', '038ddada-bc27-47cb-a8e3-6526274e0987'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:22:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d9aa65f9-e975-4c44-9449-90dbdbd54664 tempest-VolumesListTestJSON-1569838124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:22:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d9aa65f9-e975-4c44-9449-90dbdbd54664 tempest-VolumesListTestJSON-1569838124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:22:34 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d9aa65f9-e975-4c44-9449-90dbdbd54664 tempest-VolumesListTestJSON-1569838124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:22:34 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d9aa65f9-e975-4c44-9449-90dbdbd54664 tempest-VolumesListTestJSON-1569838124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:22:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d9aa65f9-e975-4c44-9449-90dbdbd54664 tempest-VolumesListTestJSON-1569838124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:22:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d9aa65f9-e975-4c44-9449-90dbdbd54664 tempest-VolumesListTestJSON-1569838124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:34 devstack sudo[91221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:22:34 devstack sudo[91221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:35 devstack sudo[91216]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_ijrdtnd6devstack@QuobyteHD" returned: 0 in 0.821s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:35 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Temporary image d11adb91-6b52-452f-a796-9ef8412183bf is fetched for user 26f78cf3cb46486e8dceaf5de4247cab. {{(pid=83863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 28 19:22:35 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd4a983-b9b9-49ae-be66-ce0f887de969]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:22:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_ijrdtnd6devstack@QuobyteHD {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:35 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-49fa1ab6-08b2-4a08-a116-b64feb33f8d8 tempest-VolumesListTestJSON-1569838124 None] Acquiring lock "cinder-5adc22ac-45a7-467d-982c-6b624e9af7bd-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:22:35 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-49fa1ab6-08b2-4a08-a116-b64feb33f8d8 tempest-VolumesListTestJSON-1569838124 None] Lock "cinder-5adc22ac-45a7-467d-982c-6b624e9af7bd-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:22:35 devstack sudo[91230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_ijrdtnd6devstack@QuobyteHD Apr 28 19:22:35 devstack sudo[91230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:35 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-49fa1ab6-08b2-4a08-a116-b64feb33f8d8 tempest-VolumesListTestJSON-1569838124 None] Acquiring lock "cinder-quobyte-5adc22ac-45a7-467d-982c-6b624e9af7bd" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:22:35 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-49fa1ab6-08b2-4a08-a116-b64feb33f8d8 tempest-VolumesListTestJSON-1569838124 None] Lock "cinder-quobyte-5adc22ac-45a7-467d-982c-6b624e9af7bd" acquired by "delete_volume" :: waited 0.021s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:22:35 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[209e8ce0-8ea3-4da9-8226-8c498daa1a83]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:22:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-49fa1ab6-08b2-4a08-a116-b64feb33f8d8 tempest-VolumesListTestJSON-1569838124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5adc22ac-45a7-467d-982c-6b624e9af7bd {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:35 devstack sudo[91219]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:35 devstack sudo[91221]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9e32f322-b94d-4296-b283-24846a4e7322 tempest-VolumesTransfersTest-881705135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fe5e5865-3a3f-470f-8cb7-4ace045a5def 1073741824" returned: 0 in 0.947s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d9aa65f9-e975-4c44-9449-90dbdbd54664 tempest-VolumesListTestJSON-1569838124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.765s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:35 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-d9aa65f9-e975-4c44-9449-90dbdbd54664 tempest-VolumesListTestJSON-1569838124 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:22:35 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-d9aa65f9-e975-4c44-9449-90dbdbd54664 tempest-VolumesListTestJSON-1569838124 None] Deleted volume successfully. Apr 28 19:22:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9e32f322-b94d-4296-b283-24846a4e7322 tempest-VolumesTransfersTest-881705135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fe5e5865-3a3f-470f-8cb7-4ace045a5def {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:35 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d9aa65f9-e975-4c44-9449-90dbdbd54664 tempest-VolumesListTestJSON-1569838124 None] Lock "cinder-d4cbb7b7-b2f2-4095-873b-7533f1f46fe5-delete_volume" released by "delete_volume" :: held 2.790s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:22:35 devstack sudo[91234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fe5e5865-3a3f-470f-8cb7-4ace045a5def Apr 28 19:22:35 devstack sudo[91234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:35 devstack sudo[91233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5adc22ac-45a7-467d-982c-6b624e9af7bd Apr 28 19:22:35 devstack sudo[91233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:36 devstack sudo[91230]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_ijrdtnd6devstack@QuobyteHD" returned: 0 in 0.804s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:22:36 devstack sudo[91234]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9e32f322-b94d-4296-b283-24846a4e7322 tempest-VolumesTransfersTest-881705135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fe5e5865-3a3f-470f-8cb7-4ace045a5def" returned: 0 in 0.641s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:36 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-9e32f322-b94d-4296-b283-24846a4e7322 tempest-VolumesTransfersTest-881705135 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:22:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9e32f322-b94d-4296-b283-24846a4e7322 tempest-VolumesTransfersTest-881705135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.650s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:22:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.173s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:22:36 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1728708495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66308b20-5e26-4941-a42b-3d710390a7cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b853b9048bad42c38d178784b365495e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:22:33Z,use_quota=True,user_id='26f78cf3cb46486e8dceaf5de4247cab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:22:36 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Creating volume 66308b20-5e26-4941-a42b-3d710390a7cc {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:22:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:22:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:22:36 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:22:36 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:22:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:22:36 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:22:36 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:22:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-66308b20-5e26-4941-a42b-3d710390a7cc 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:36 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9e32f322-b94d-4296-b283-24846a4e7322 tempest-VolumesTransfersTest-881705135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b63093af-7816-4185-ac53-bf8460d8ebf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe5e5865-3a3f-470f-8cb7-4ace045a5def', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:36 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9e32f322-b94d-4296-b283-24846a4e7322 tempest-VolumesTransfersTest-881705135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (319f6126-4fae-4837-b595-a763c5674111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:36 devstack sudo[91244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-66308b20-5e26-4941-a42b-3d710390a7cc 1073741824 Apr 28 19:22:36 devstack sudo[91244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:36 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-9e32f322-b94d-4296-b283-24846a4e7322 tempest-VolumesTransfersTest-881705135 None] Volume volume-fe5e5865-3a3f-470f-8cb7-4ace045a5def (fe5e5865-3a3f-470f-8cb7-4ace045a5def): created successfully Apr 28 19:22:36 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9e32f322-b94d-4296-b283-24846a4e7322 tempest-VolumesTransfersTest-881705135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (319f6126-4fae-4837-b595-a763c5674111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:36 devstack sudo[91233]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:36 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9e32f322-b94d-4296-b283-24846a4e7322 tempest-VolumesTransfersTest-881705135 None] Flow 'volume_create_manager' (8c2a2032-afe3-447b-841b-9180226f0d23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:22:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-49fa1ab6-08b2-4a08-a116-b64feb33f8d8 tempest-VolumesListTestJSON-1569838124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5adc22ac-45a7-467d-982c-6b624e9af7bd" returned: 0 in 0.812s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-49fa1ab6-08b2-4a08-a116-b64feb33f8d8 tempest-VolumesListTestJSON-1569838124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5adc22ac-45a7-467d-982c-6b624e9af7bd {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:36 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-9e32f322-b94d-4296-b283-24846a4e7322 tempest-VolumesTransfersTest-881705135 None] Created volume successfully. Apr 28 19:22:36 devstack sudo[91260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5adc22ac-45a7-467d-982c-6b624e9af7bd Apr 28 19:22:36 devstack sudo[91260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:37 devstack sudo[91260]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-49fa1ab6-08b2-4a08-a116-b64feb33f8d8 tempest-VolumesListTestJSON-1569838124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5adc22ac-45a7-467d-982c-6b624e9af7bd" returned: 0 in 0.785s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:37 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-49fa1ab6-08b2-4a08-a116-b64feb33f8d8 tempest-VolumesListTestJSON-1569838124 None] Lock "cinder-quobyte-5adc22ac-45a7-467d-982c-6b624e9af7bd" released by "delete_volume" :: held 1.648s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:22:37 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-49fa1ab6-08b2-4a08-a116-b64feb33f8d8 tempest-VolumesListTestJSON-1569838124 None] Created reservations ['040ad8fd-fee7-4c10-8c30-ac35bca04f65', 'e69e6cd5-57c4-4fa0-9ec5-c5739ec36694', 'c70d0727-2a0a-40ca-8502-0bee0271469e', '7c657f79-eac1-47f9-8fdf-f351d19ba295'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:22:37 devstack sudo[91244]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-66308b20-5e26-4941-a42b-3d710390a7cc 1073741824" returned: 0 in 0.970s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-49fa1ab6-08b2-4a08-a116-b64feb33f8d8 tempest-VolumesListTestJSON-1569838124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:22:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-49fa1ab6-08b2-4a08-a116-b64feb33f8d8 tempest-VolumesListTestJSON-1569838124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:22:37 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-49fa1ab6-08b2-4a08-a116-b64feb33f8d8 tempest-VolumesListTestJSON-1569838124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:22:37 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-49fa1ab6-08b2-4a08-a116-b64feb33f8d8 tempest-VolumesListTestJSON-1569838124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:22:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-49fa1ab6-08b2-4a08-a116-b64feb33f8d8 tempest-VolumesListTestJSON-1569838124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:22:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-49fa1ab6-08b2-4a08-a116-b64feb33f8d8 tempest-VolumesListTestJSON-1569838124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:37 devstack sudo[91288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:22:37 devstack sudo[91288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-66308b20-5e26-4941-a42b-3d710390a7cc {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:37 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-7b8b2839-f27f-41ac-8fa3-cbf17ec0671e tempest-VolumesTransfersTest-315994834 None] Transfer volume completed successfully. Apr 28 19:22:37 devstack sudo[91290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-66308b20-5e26-4941-a42b-3d710390a7cc Apr 28 19:22:37 devstack sudo[91290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:37 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-862c0e00-8421-4c2d-887e-b84df6a97811 tempest-VolumesListTestJSON-1569838124 None] Acquiring lock "cinder-a058054e-ef43-4d5f-9796-4bd98a97d051-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:22:37 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-862c0e00-8421-4c2d-887e-b84df6a97811 tempest-VolumesListTestJSON-1569838124 None] Lock "cinder-a058054e-ef43-4d5f-9796-4bd98a97d051-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:22:37 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-862c0e00-8421-4c2d-887e-b84df6a97811 tempest-VolumesListTestJSON-1569838124 None] Acquiring lock "cinder-quobyte-a058054e-ef43-4d5f-9796-4bd98a97d051" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:22:37 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-862c0e00-8421-4c2d-887e-b84df6a97811 tempest-VolumesListTestJSON-1569838124 None] Lock "cinder-quobyte-a058054e-ef43-4d5f-9796-4bd98a97d051" acquired by "delete_volume" :: waited 0.038s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:22:37 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d5352e-1093-48eb-9649-c8413384b581]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:22:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-862c0e00-8421-4c2d-887e-b84df6a97811 tempest-VolumesListTestJSON-1569838124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a058054e-ef43-4d5f-9796-4bd98a97d051 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:38 devstack sudo[91288]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-49fa1ab6-08b2-4a08-a116-b64feb33f8d8 tempest-VolumesListTestJSON-1569838124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.673s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:38 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-49fa1ab6-08b2-4a08-a116-b64feb33f8d8 tempest-VolumesListTestJSON-1569838124 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:22:38 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-49fa1ab6-08b2-4a08-a116-b64feb33f8d8 tempest-VolumesListTestJSON-1569838124 None] Deleted volume successfully. Apr 28 19:22:38 devstack sudo[91290]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-66308b20-5e26-4941-a42b-3d710390a7cc" returned: 0 in 0.658s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:38 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] <== create_volume: return (1712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:22:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.717s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:22:38 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-49fa1ab6-08b2-4a08-a116-b64feb33f8d8 tempest-VolumesListTestJSON-1569838124 None] Lock "cinder-5adc22ac-45a7-467d-982c-6b624e9af7bd-delete_volume" released by "delete_volume" :: held 2.556s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:22:38 devstack cinder-volume[83863]: DEBUG cinder.volume.volume_utils [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Attempting download of d11adb91-6b52-452f-a796-9ef8412183bf ((None, [{'url': 'file:///opt/stack/data/glance/images/d11adb91-6b52-452f-a796-9ef8412183bf', 'metadata': {}}])) to volume 66308b20-5e26-4941-a42b-3d710390a7cc. {{(pid=83863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 28 19:22:38 devstack sudo[91294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a058054e-ef43-4d5f-9796-4bd98a97d051 Apr 28 19:22:38 devstack sudo[91294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:38 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2814f4-c522-495b-84db-7caaf1c8ac87]: (4, 'raw') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:22:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d11adb91-6b52-452f-a796-9ef8412183bf_gpqw649z {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:38 devstack sudo[91296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d11adb91-6b52-452f-a796-9ef8412183bf_gpqw649z Apr 28 19:22:38 devstack sudo[91296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:38 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-63af5b21-3366-4a88-a4e5-48a711c763ef tempest-VolumesTransfersTest-1171122293 None] Acquiring lock "cinder-fe5e5865-3a3f-470f-8cb7-4ace045a5def-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:22:38 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-63af5b21-3366-4a88-a4e5-48a711c763ef tempest-VolumesTransfersTest-1171122293 None] Lock "cinder-fe5e5865-3a3f-470f-8cb7-4ace045a5def-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:22:38 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-63af5b21-3366-4a88-a4e5-48a711c763ef tempest-VolumesTransfersTest-1171122293 None] Acquiring lock "cinder-quobyte-fe5e5865-3a3f-470f-8cb7-4ace045a5def" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:22:38 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-63af5b21-3366-4a88-a4e5-48a711c763ef tempest-VolumesTransfersTest-1171122293 None] Lock "cinder-quobyte-fe5e5865-3a3f-470f-8cb7-4ace045a5def" acquired by "delete_volume" :: waited 0.020s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:22:38 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b1cf10-65cb-4ccf-a120-5eac2dbb245e]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:22:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-63af5b21-3366-4a88-a4e5-48a711c763ef tempest-VolumesTransfersTest-1171122293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fe5e5865-3a3f-470f-8cb7-4ace045a5def {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:38 devstack sudo[91298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fe5e5865-3a3f-470f-8cb7-4ace045a5def Apr 28 19:22:38 devstack sudo[91298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:38 devstack sudo[91294]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-862c0e00-8421-4c2d-887e-b84df6a97811 tempest-VolumesListTestJSON-1569838124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a058054e-ef43-4d5f-9796-4bd98a97d051" returned: 0 in 0.827s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-862c0e00-8421-4c2d-887e-b84df6a97811 tempest-VolumesListTestJSON-1569838124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a058054e-ef43-4d5f-9796-4bd98a97d051 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:38 devstack sudo[91305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a058054e-ef43-4d5f-9796-4bd98a97d051 Apr 28 19:22:38 devstack sudo[91305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:38 devstack sudo[91296]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d11adb91-6b52-452f-a796-9ef8412183bf_gpqw649z" returned: 0 in 0.717s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d11adb91-6b52-452f-a796-9ef8412183bf_gpqw649z {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:39 devstack sudo[91307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d11adb91-6b52-452f-a796-9ef8412183bf_gpqw649z Apr 28 19:22:39 devstack sudo[91307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:39 devstack sudo[91298]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-63af5b21-3366-4a88-a4e5-48a711c763ef tempest-VolumesTransfersTest-1171122293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fe5e5865-3a3f-470f-8cb7-4ace045a5def" returned: 0 in 0.778s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-63af5b21-3366-4a88-a4e5-48a711c763ef tempest-VolumesTransfersTest-1171122293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fe5e5865-3a3f-470f-8cb7-4ace045a5def {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:39 devstack sudo[91312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fe5e5865-3a3f-470f-8cb7-4ace045a5def Apr 28 19:22:39 devstack sudo[91312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:39 devstack sudo[91305]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-862c0e00-8421-4c2d-887e-b84df6a97811 tempest-VolumesListTestJSON-1569838124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a058054e-ef43-4d5f-9796-4bd98a97d051" returned: 0 in 0.621s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:39 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-862c0e00-8421-4c2d-887e-b84df6a97811 tempest-VolumesListTestJSON-1569838124 None] Lock "cinder-quobyte-a058054e-ef43-4d5f-9796-4bd98a97d051" released by "delete_volume" :: held 1.501s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:22:39 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-862c0e00-8421-4c2d-887e-b84df6a97811 tempest-VolumesListTestJSON-1569838124 None] Created reservations ['8997ac64-e930-4c24-a5b4-193ecdf96d6a', '9cd54338-cee5-453c-bf72-be50a8e1cc1d', '8e27f8f7-91e6-4a97-8ed2-35ca63d04917', '607178f0-45a5-4e5c-88b5-535347571af1'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:22:39 devstack sudo[91307]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d11adb91-6b52-452f-a796-9ef8412183bf_gpqw649z" returned: 1 in 0.695s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d11adb91-6b52-452f-a796-9ef8412183bf_gpqw649z' failed. Not Retrying. {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 19:22:39 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1b8a8e-0787-42cb-aa52-7a392ca9d09c]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:22:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_ijrdtnd6devstack@QuobyteHD {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-862c0e00-8421-4c2d-887e-b84df6a97811 tempest-VolumesListTestJSON-1569838124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:22:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-862c0e00-8421-4c2d-887e-b84df6a97811 tempest-VolumesListTestJSON-1569838124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:22:39 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-862c0e00-8421-4c2d-887e-b84df6a97811 tempest-VolumesListTestJSON-1569838124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:22:39 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-862c0e00-8421-4c2d-887e-b84df6a97811 tempest-VolumesListTestJSON-1569838124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:22:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-862c0e00-8421-4c2d-887e-b84df6a97811 tempest-VolumesListTestJSON-1569838124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:22:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-862c0e00-8421-4c2d-887e-b84df6a97811 tempest-VolumesListTestJSON-1569838124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:39 devstack sudo[91318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:22:39 devstack sudo[91318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:39 devstack sudo[91317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_ijrdtnd6devstack@QuobyteHD Apr 28 19:22:39 devstack sudo[91317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:39 devstack sudo[91312]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-63af5b21-3366-4a88-a4e5-48a711c763ef tempest-VolumesTransfersTest-1171122293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fe5e5865-3a3f-470f-8cb7-4ace045a5def" returned: 0 in 0.636s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:39 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-63af5b21-3366-4a88-a4e5-48a711c763ef tempest-VolumesTransfersTest-1171122293 None] Lock "cinder-quobyte-fe5e5865-3a3f-470f-8cb7-4ace045a5def" released by "delete_volume" :: held 1.457s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:22:39 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-63af5b21-3366-4a88-a4e5-48a711c763ef tempest-VolumesTransfersTest-1171122293 None] Created reservations ['acfa6b1f-4276-4cb7-af61-f191908a23a4', '7478f49a-2c78-4899-814d-4edb81ab86e3', '55e8663e-39f8-4ed1-bf65-0719bb8f3e8e', '3f82a87a-4cc0-4730-b372-34d41d402a23'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:22:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-63af5b21-3366-4a88-a4e5-48a711c763ef tempest-VolumesTransfersTest-1171122293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:22:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-63af5b21-3366-4a88-a4e5-48a711c763ef tempest-VolumesTransfersTest-1171122293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:22:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-63af5b21-3366-4a88-a4e5-48a711c763ef tempest-VolumesTransfersTest-1171122293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:22:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-63af5b21-3366-4a88-a4e5-48a711c763ef tempest-VolumesTransfersTest-1171122293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:22:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-63af5b21-3366-4a88-a4e5-48a711c763ef tempest-VolumesTransfersTest-1171122293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:22:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-63af5b21-3366-4a88-a4e5-48a711c763ef tempest-VolumesTransfersTest-1171122293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:40 devstack sudo[91322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:22:40 devstack sudo[91322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:40 devstack sudo[91318]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-862c0e00-8421-4c2d-887e-b84df6a97811 tempest-VolumesListTestJSON-1569838124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.683s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:40 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-862c0e00-8421-4c2d-887e-b84df6a97811 tempest-VolumesListTestJSON-1569838124 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:22:40 devstack sudo[91317]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:40 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-862c0e00-8421-4c2d-887e-b84df6a97811 tempest-VolumesListTestJSON-1569838124 None] Deleted volume successfully. Apr 28 19:22:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_ijrdtnd6devstack@QuobyteHD" returned: 0 in 0.723s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:40 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] d11adb91-6b52-452f-a796-9ef8412183bf was qcow2, converting to raw {{(pid=83863) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 28 19:22:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_ijrdtnd6devstack@QuobyteHD /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-66308b20-5e26-4941-a42b-3d710390a7cc {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:40 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-862c0e00-8421-4c2d-887e-b84df6a97811 tempest-VolumesListTestJSON-1569838124 None] Lock "cinder-a058054e-ef43-4d5f-9796-4bd98a97d051-delete_volume" released by "delete_volume" :: held 2.505s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:22:40 devstack sudo[91329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_ijrdtnd6devstack@QuobyteHD /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-66308b20-5e26-4941-a42b-3d710390a7cc Apr 28 19:22:40 devstack sudo[91329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:40 devstack sudo[91322]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-63af5b21-3366-4a88-a4e5-48a711c763ef tempest-VolumesTransfersTest-1171122293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.695s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:40 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-63af5b21-3366-4a88-a4e5-48a711c763ef tempest-VolumesTransfersTest-1171122293 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:22:40 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-63af5b21-3366-4a88-a4e5-48a711c763ef tempest-VolumesTransfersTest-1171122293 None] Deleted volume successfully. Apr 28 19:22:40 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-63af5b21-3366-4a88-a4e5-48a711c763ef tempest-VolumesTransfersTest-1171122293 None] Lock "cinder-fe5e5865-3a3f-470f-8cb7-4ace045a5def-delete_volume" released by "delete_volume" :: held 2.380s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:22:41 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d0cb595-3771-4e64-adc2-61a470f7630e tempest-VolumesTransfersTest-881705135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:22:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0d0cb595-3771-4e64-adc2-61a470f7630e tempest-VolumesTransfersTest-881705135 None] Flow 'volume_create_manager' (6095406e-c02c-402d-8b77-83407fd28c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:22:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0d0cb595-3771-4e64-adc2-61a470f7630e tempest-VolumesTransfersTest-881705135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f4d4018-c1df-40b9-8278-3b16ecd3ef2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0d0cb595-3771-4e64-adc2-61a470f7630e tempest-VolumesTransfersTest-881705135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f4d4018-c1df-40b9-8278-3b16ecd3ef2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2117586452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4c612be-621c-4b34-be6f-94caf60df277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c1a1c35fa04a189b932eb0a8d40830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:22:41Z,use_quota=True,user_id='512a881b31ad4e3c953a7e757e955032',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0d0cb595-3771-4e64-adc2-61a470f7630e tempest-VolumesTransfersTest-881705135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e16bf51-bd0e-4f70-b68a-42c055c1aeaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0d0cb595-3771-4e64-adc2-61a470f7630e tempest-VolumesTransfersTest-881705135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e16bf51-bd0e-4f70-b68a-42c055c1aeaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0d0cb595-3771-4e64-adc2-61a470f7630e tempest-VolumesTransfersTest-881705135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfe7188e-d140-4c83-83e4-abe42830a1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0d0cb595-3771-4e64-adc2-61a470f7630e tempest-VolumesTransfersTest-881705135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfe7188e-d140-4c83-83e4-abe42830a1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4c612be-621c-4b34-be6f-94caf60df277', 'volume_name': 'volume-d4c612be-621c-4b34-be6f-94caf60df277', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0d0cb595-3771-4e64-adc2-61a470f7630e tempest-VolumesTransfersTest-881705135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bddd119e-dc9d-49cc-9afb-bac648a4e6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0d0cb595-3771-4e64-adc2-61a470f7630e tempest-VolumesTransfersTest-881705135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bddd119e-dc9d-49cc-9afb-bac648a4e6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0d0cb595-3771-4e64-adc2-61a470f7630e tempest-VolumesTransfersTest-881705135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba532190-9cfd-418b-a06f-edf0af2b0db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:41 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-0d0cb595-3771-4e64-adc2-61a470f7630e tempest-VolumesTransfersTest-881705135 None] Volume d4c612be-621c-4b34-be6f-94caf60df277: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4c612be-621c-4b34-be6f-94caf60df277', 'volume_size': 1} Apr 28 19:22:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0d0cb595-3771-4e64-adc2-61a470f7630e tempest-VolumesTransfersTest-881705135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:22:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0d0cb595-3771-4e64-adc2-61a470f7630e tempest-VolumesTransfersTest-881705135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:22:41 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0d0cb595-3771-4e64-adc2-61a470f7630e tempest-VolumesTransfersTest-881705135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2117586452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4c612be-621c-4b34-be6f-94caf60df277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c1a1c35fa04a189b932eb0a8d40830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:22:41Z,use_quota=True,user_id='512a881b31ad4e3c953a7e757e955032',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:22:41 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-0d0cb595-3771-4e64-adc2-61a470f7630e tempest-VolumesTransfersTest-881705135 None] Creating volume d4c612be-621c-4b34-be6f-94caf60df277 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:22:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0d0cb595-3771-4e64-adc2-61a470f7630e tempest-VolumesTransfersTest-881705135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:22:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0d0cb595-3771-4e64-adc2-61a470f7630e tempest-VolumesTransfersTest-881705135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:22:41 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0d0cb595-3771-4e64-adc2-61a470f7630e tempest-VolumesTransfersTest-881705135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:22:41 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0d0cb595-3771-4e64-adc2-61a470f7630e tempest-VolumesTransfersTest-881705135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:22:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0d0cb595-3771-4e64-adc2-61a470f7630e tempest-VolumesTransfersTest-881705135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:22:41 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0d0cb595-3771-4e64-adc2-61a470f7630e tempest-VolumesTransfersTest-881705135 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:22:41 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-0d0cb595-3771-4e64-adc2-61a470f7630e tempest-VolumesTransfersTest-881705135 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:22:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0d0cb595-3771-4e64-adc2-61a470f7630e tempest-VolumesTransfersTest-881705135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d4c612be-621c-4b34-be6f-94caf60df277 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:41 devstack sudo[91342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d4c612be-621c-4b34-be6f-94caf60df277 1073741824 Apr 28 19:22:41 devstack sudo[91342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:42 devstack sudo[91342]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0d0cb595-3771-4e64-adc2-61a470f7630e tempest-VolumesTransfersTest-881705135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d4c612be-621c-4b34-be6f-94caf60df277 1073741824" returned: 0 in 1.029s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0d0cb595-3771-4e64-adc2-61a470f7630e tempest-VolumesTransfersTest-881705135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d4c612be-621c-4b34-be6f-94caf60df277 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:42 devstack sudo[91348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d4c612be-621c-4b34-be6f-94caf60df277 Apr 28 19:22:42 devstack sudo[91348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:42 devstack sudo[91329]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_ijrdtnd6devstack@QuobyteHD /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-66308b20-5e26-4941-a42b-3d710390a7cc" returned: 0 in 2.342s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:42 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d11adb91-6b52-452f-a796-9ef8412183bf_ijrdtnd6devstack@QuobyteHD, size 112.00 MB, duration 2.34 sec, destination /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-66308b20-5e26-4941-a42b-3d710390a7cc {{(pid=83863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 19:22:42 devstack cinder-volume[83863]: INFO cinder.image.image_utils [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Converted 112.00 MB image at 47.80 MB/s Apr 28 19:22:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-66308b20-5e26-4941-a42b-3d710390a7cc 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:42 devstack sudo[91350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-66308b20-5e26-4941-a42b-3d710390a7cc 1G Apr 28 19:22:42 devstack sudo[91350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:43 devstack sudo[91348]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0d0cb595-3771-4e64-adc2-61a470f7630e tempest-VolumesTransfersTest-881705135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d4c612be-621c-4b34-be6f-94caf60df277" returned: 0 in 0.659s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:43 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0d0cb595-3771-4e64-adc2-61a470f7630e tempest-VolumesTransfersTest-881705135 None] <== create_volume: return (1731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:22:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0d0cb595-3771-4e64-adc2-61a470f7630e tempest-VolumesTransfersTest-881705135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.739s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:22:43 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0d0cb595-3771-4e64-adc2-61a470f7630e tempest-VolumesTransfersTest-881705135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba532190-9cfd-418b-a06f-edf0af2b0db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4c612be-621c-4b34-be6f-94caf60df277', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:43 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0d0cb595-3771-4e64-adc2-61a470f7630e tempest-VolumesTransfersTest-881705135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5ac8f6b-3a08-45e7-b4e7-4e18b361687c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:43 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-0d0cb595-3771-4e64-adc2-61a470f7630e tempest-VolumesTransfersTest-881705135 None] Volume volume-d4c612be-621c-4b34-be6f-94caf60df277 (d4c612be-621c-4b34-be6f-94caf60df277): created successfully Apr 28 19:22:43 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0d0cb595-3771-4e64-adc2-61a470f7630e tempest-VolumesTransfersTest-881705135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5ac8f6b-3a08-45e7-b4e7-4e18b361687c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:43 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0d0cb595-3771-4e64-adc2-61a470f7630e tempest-VolumesTransfersTest-881705135 None] Flow 'volume_create_manager' (6095406e-c02c-402d-8b77-83407fd28c30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:22:43 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-0d0cb595-3771-4e64-adc2-61a470f7630e tempest-VolumesTransfersTest-881705135 None] Created volume successfully. Apr 28 19:22:43 devstack sudo[91350]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-66308b20-5e26-4941-a42b-3d710390a7cc 1G" returned: 0 in 0.728s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:43 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9d2e41-fcb2-4549-9d93-3ef732cf3a81]: (4, 'raw') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:22:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-66308b20-5e26-4941-a42b-3d710390a7cc {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:43 devstack sudo[91356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-66308b20-5e26-4941-a42b-3d710390a7cc Apr 28 19:22:43 devstack sudo[91356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:43 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4fa8a2b0-af6e-4a4a-a130-df40e436924b tempest-VolumesTransfersTest-1171122293 None] Acquiring lock "cinder-d4c612be-621c-4b34-be6f-94caf60df277-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:22:43 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4fa8a2b0-af6e-4a4a-a130-df40e436924b tempest-VolumesTransfersTest-1171122293 None] Lock "cinder-d4c612be-621c-4b34-be6f-94caf60df277-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:22:43 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4fa8a2b0-af6e-4a4a-a130-df40e436924b tempest-VolumesTransfersTest-1171122293 None] Acquiring lock "cinder-quobyte-d4c612be-621c-4b34-be6f-94caf60df277" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:22:43 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4fa8a2b0-af6e-4a4a-a130-df40e436924b tempest-VolumesTransfersTest-1171122293 None] Lock "cinder-quobyte-d4c612be-621c-4b34-be6f-94caf60df277" acquired by "delete_volume" :: waited 0.016s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:22:43 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53a8a16-572f-4367-a4d1-c117e8a474cc]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:22:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4fa8a2b0-af6e-4a4a-a130-df40e436924b tempest-VolumesTransfersTest-1171122293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d4c612be-621c-4b34-be6f-94caf60df277 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:43 devstack sudo[91358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d4c612be-621c-4b34-be6f-94caf60df277 Apr 28 19:22:43 devstack sudo[91358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:44 devstack sudo[91356]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-66308b20-5e26-4941-a42b-3d710390a7cc" returned: 0 in 0.846s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-66308b20-5e26-4941-a42b-3d710390a7cc {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:44 devstack sudo[91362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-66308b20-5e26-4941-a42b-3d710390a7cc Apr 28 19:22:44 devstack sudo[91362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:44 devstack sudo[91358]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4fa8a2b0-af6e-4a4a-a130-df40e436924b tempest-VolumesTransfersTest-1171122293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d4c612be-621c-4b34-be6f-94caf60df277" returned: 0 in 0.808s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4fa8a2b0-af6e-4a4a-a130-df40e436924b tempest-VolumesTransfersTest-1171122293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d4c612be-621c-4b34-be6f-94caf60df277 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:44 devstack sudo[91367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d4c612be-621c-4b34-be6f-94caf60df277 Apr 28 19:22:44 devstack sudo[91367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:45 devstack sudo[91362]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-66308b20-5e26-4941-a42b-3d710390a7cc" returned: 1 in 0.748s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-66308b20-5e26-4941-a42b-3d710390a7cc' failed. Not Retrying. {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 19:22:45 devstack cinder-volume[83863]: DEBUG cinder.volume.volume_utils [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Downloaded image d11adb91-6b52-452f-a796-9ef8412183bf ((None, [{'url': 'file:///opt/stack/data/glance/images/d11adb91-6b52-452f-a796-9ef8412183bf', 'metadata': {}}])) to volume 66308b20-5e26-4941-a42b-3d710390a7cc successfully. {{(pid=83863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 28 19:22:45 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Temporary image d11adb91-6b52-452f-a796-9ef8412183bf for user 26f78cf3cb46486e8dceaf5de4247cab is deleted. {{(pid=83863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 28 19:22:45 devstack cinder-volume[83863]: DEBUG cinder.volume.volume_utils [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Marking volume 66308b20-5e26-4941-a42b-3d710390a7cc as bootable. {{(pid=83863) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 28 19:22:45 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Copying metadata from image d11adb91-6b52-452f-a796-9ef8412183bf to 66308b20-5e26-4941-a42b-3d710390a7cc. {{(pid=83863) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 28 19:22:45 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Creating volume glance metadata for volume 66308b20-5e26-4941-a42b-3d710390a7cc backed by image d11adb91-6b52-452f-a796-9ef8412183bf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd11adb91-6b52-452f-a796-9ef8412183bf', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83863) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 28 19:22:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6c3008f-17d4-4782-8e7f-c25d07f30319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66308b20-5e26-4941-a42b-3d710390a7cc', 'volume_size': 1, 'image_id': 'd11adb91-6b52-452f-a796-9ef8412183bf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d11adb91-6b52-452f-a796-9ef8412183bf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6469daf89505401a8582e1f501a60d80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd11adb91-6b52-452f-a796-9ef8412183bf', 'created_at': datetime.datetime(2026, 4, 28, 17, 9, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 17, 9, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d11adb91-6b52-452f-a796-9ef8412183bf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e52f6d14-87fe-4051-87dc-bcda2c4fe809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:45 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Volume volume-66308b20-5e26-4941-a42b-3d710390a7cc (66308b20-5e26-4941-a42b-3d710390a7cc): created successfully Apr 28 19:22:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e52f6d14-87fe-4051-87dc-bcda2c4fe809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Flow 'volume_create_manager' (614ac311-d926-4ec6-9a2e-76c23cda8b22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:22:45 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-b2e15535-29b1-40cc-aca0-b1ff751cd3f1 tempest-VolumesExtendTest-398125600 None] Created volume successfully. Apr 28 19:22:45 devstack sudo[91367]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4fa8a2b0-af6e-4a4a-a130-df40e436924b tempest-VolumesTransfersTest-1171122293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d4c612be-621c-4b34-be6f-94caf60df277" returned: 0 in 0.710s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:45 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4fa8a2b0-af6e-4a4a-a130-df40e436924b tempest-VolumesTransfersTest-1171122293 None] Lock "cinder-quobyte-d4c612be-621c-4b34-be6f-94caf60df277" released by "delete_volume" :: held 1.575s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:22:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-153f666b-19af-46fd-bc2c-45cd21ac18c4 tempest-VolumesExtendTest-398125600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:22:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-153f666b-19af-46fd-bc2c-45cd21ac18c4 tempest-VolumesExtendTest-398125600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:22:45 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-4fa8a2b0-af6e-4a4a-a130-df40e436924b tempest-VolumesTransfersTest-1171122293 None] Created reservations ['0fe3d516-e668-453b-a80d-f637ed22f0fc', '9728ca2c-3b2d-43ec-bd5b-22e804495daf', '22bddcb1-5df8-4ade-aced-b34ceaff825d', 'b5d2d290-6b88-4731-a452-9fbac992c27a'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:22:45 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcaf0e1-b050-4834-9717-458ca1dfc6aa]: (4, 'raw') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:22:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-153f666b-19af-46fd-bc2c-45cd21ac18c4 tempest-VolumesExtendTest-398125600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-66308b20-5e26-4941-a42b-3d710390a7cc {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4fa8a2b0-af6e-4a4a-a130-df40e436924b tempest-VolumesTransfersTest-1171122293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:22:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4fa8a2b0-af6e-4a4a-a130-df40e436924b tempest-VolumesTransfersTest-1171122293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:22:45 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4fa8a2b0-af6e-4a4a-a130-df40e436924b tempest-VolumesTransfersTest-1171122293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:22:45 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4fa8a2b0-af6e-4a4a-a130-df40e436924b tempest-VolumesTransfersTest-1171122293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:22:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4fa8a2b0-af6e-4a4a-a130-df40e436924b tempest-VolumesTransfersTest-1171122293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:22:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4fa8a2b0-af6e-4a4a-a130-df40e436924b tempest-VolumesTransfersTest-1171122293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:45 devstack sudo[91374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:22:45 devstack sudo[91374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:45 devstack sudo[91373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-66308b20-5e26-4941-a42b-3d710390a7cc Apr 28 19:22:45 devstack sudo[91373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:46 devstack sudo[91374]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4fa8a2b0-af6e-4a4a-a130-df40e436924b tempest-VolumesTransfersTest-1171122293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.692s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:46 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-4fa8a2b0-af6e-4a4a-a130-df40e436924b tempest-VolumesTransfersTest-1171122293 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:22:46 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-4fa8a2b0-af6e-4a4a-a130-df40e436924b tempest-VolumesTransfersTest-1171122293 None] Deleted volume successfully. Apr 28 19:22:46 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4fa8a2b0-af6e-4a4a-a130-df40e436924b tempest-VolumesTransfersTest-1171122293 None] Lock "cinder-d4c612be-621c-4b34-be6f-94caf60df277-delete_volume" released by "delete_volume" :: held 2.545s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:22:46 devstack sudo[91373]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-153f666b-19af-46fd-bc2c-45cd21ac18c4 tempest-VolumesExtendTest-398125600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-66308b20-5e26-4941-a42b-3d710390a7cc" returned: 0 in 0.835s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-153f666b-19af-46fd-bc2c-45cd21ac18c4 tempest-VolumesExtendTest-398125600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-66308b20-5e26-4941-a42b-3d710390a7cc {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:46 devstack sudo[91386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-66308b20-5e26-4941-a42b-3d710390a7cc Apr 28 19:22:46 devstack sudo[91386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:47 devstack sudo[91386]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-153f666b-19af-46fd-bc2c-45cd21ac18c4 tempest-VolumesExtendTest-398125600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-66308b20-5e26-4941-a42b-3d710390a7cc" returned: 1 in 0.814s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-153f666b-19af-46fd-bc2c-45cd21ac18c4 tempest-VolumesExtendTest-398125600 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-66308b20-5e26-4941-a42b-3d710390a7cc' failed. Not Retrying. {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 19:22:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-153f666b-19af-46fd-bc2c-45cd21ac18c4 tempest-VolumesExtendTest-398125600 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-66308b20-5e26-4941-a42b-3d710390a7cc 2G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-153f666b-19af-46fd-bc2c-45cd21ac18c4 tempest-VolumesExtendTest-398125600 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-66308b20-5e26-4941-a42b-3d710390a7cc 2G" returned: 0 in 0.079s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-153f666b-19af-46fd-bc2c-45cd21ac18c4 tempest-VolumesExtendTest-398125600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.795s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:22:47 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-153f666b-19af-46fd-bc2c-45cd21ac18c4 tempest-VolumesExtendTest-398125600 None] Extend volume completed successfully. Apr 28 19:22:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5157ece4-8e07-4649-9ad1-655921defd4e tempest-VolumesExtendTest-398125600 None] Acquiring lock "cinder-66308b20-5e26-4941-a42b-3d710390a7cc-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:22:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5157ece4-8e07-4649-9ad1-655921defd4e tempest-VolumesExtendTest-398125600 None] Lock "cinder-66308b20-5e26-4941-a42b-3d710390a7cc-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:22:48 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5157ece4-8e07-4649-9ad1-655921defd4e tempest-VolumesExtendTest-398125600 None] Acquiring lock "cinder-quobyte-66308b20-5e26-4941-a42b-3d710390a7cc" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:22:48 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5157ece4-8e07-4649-9ad1-655921defd4e tempest-VolumesExtendTest-398125600 None] Lock "cinder-quobyte-66308b20-5e26-4941-a42b-3d710390a7cc" acquired by "delete_volume" :: waited 0.063s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:22:48 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc907565-94a7-4ebd-afe8-d7e2de5ef25d]: (4, 'raw') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:22:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5157ece4-8e07-4649-9ad1-655921defd4e tempest-VolumesExtendTest-398125600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-66308b20-5e26-4941-a42b-3d710390a7cc {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:48 devstack sudo[91395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-66308b20-5e26-4941-a42b-3d710390a7cc Apr 28 19:22:48 devstack sudo[91395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:49 devstack sudo[91395]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5157ece4-8e07-4649-9ad1-655921defd4e tempest-VolumesExtendTest-398125600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-66308b20-5e26-4941-a42b-3d710390a7cc" returned: 0 in 0.832s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5157ece4-8e07-4649-9ad1-655921defd4e tempest-VolumesExtendTest-398125600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-66308b20-5e26-4941-a42b-3d710390a7cc {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:49 devstack sudo[91399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-66308b20-5e26-4941-a42b-3d710390a7cc Apr 28 19:22:49 devstack sudo[91399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:49 devstack sudo[91399]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5157ece4-8e07-4649-9ad1-655921defd4e tempest-VolumesExtendTest-398125600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-66308b20-5e26-4941-a42b-3d710390a7cc" returned: 1 in 0.822s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5157ece4-8e07-4649-9ad1-655921defd4e tempest-VolumesExtendTest-398125600 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-66308b20-5e26-4941-a42b-3d710390a7cc' failed. Not Retrying. {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 19:22:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5157ece4-8e07-4649-9ad1-655921defd4e tempest-VolumesExtendTest-398125600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-66308b20-5e26-4941-a42b-3d710390a7cc {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:49 devstack sudo[91404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-66308b20-5e26-4941-a42b-3d710390a7cc Apr 28 19:22:49 devstack sudo[91404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:50 devstack sudo[91404]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5157ece4-8e07-4649-9ad1-655921defd4e tempest-VolumesExtendTest-398125600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-66308b20-5e26-4941-a42b-3d710390a7cc" returned: 0 in 0.692s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:50 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5157ece4-8e07-4649-9ad1-655921defd4e tempest-VolumesExtendTest-398125600 None] Lock "cinder-quobyte-66308b20-5e26-4941-a42b-3d710390a7cc" released by "delete_volume" :: held 2.465s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:22:50 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:INSERT=58,cinder:UPDATE=166,cinder:SELECT=134,cinder:DELETE=13 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 19:22:50 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:SELECT=134,cinder:INSERT=49,cinder:UPDATE=182,cinder:DELETE=13 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 19:22:50 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-5157ece4-8e07-4649-9ad1-655921defd4e tempest-VolumesExtendTest-398125600 None] Created reservations ['9873b725-fb85-4f8c-8c07-5ce9e855cb7f', 'e634802b-8c02-4de9-96e9-140f018ea74a', 'db038652-27dd-447d-9239-6ac454f164e4', '8a375975-3929-4611-88c9-8644654ae77a'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:22:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5157ece4-8e07-4649-9ad1-655921defd4e tempest-VolumesExtendTest-398125600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:22:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5157ece4-8e07-4649-9ad1-655921defd4e tempest-VolumesExtendTest-398125600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:22:50 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5157ece4-8e07-4649-9ad1-655921defd4e tempest-VolumesExtendTest-398125600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:22:50 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5157ece4-8e07-4649-9ad1-655921defd4e tempest-VolumesExtendTest-398125600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:22:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5157ece4-8e07-4649-9ad1-655921defd4e tempest-VolumesExtendTest-398125600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:22:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5157ece4-8e07-4649-9ad1-655921defd4e tempest-VolumesExtendTest-398125600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:50 devstack sudo[91407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:22:50 devstack sudo[91407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:51 devstack sudo[91407]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5157ece4-8e07-4649-9ad1-655921defd4e tempest-VolumesExtendTest-398125600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.893s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:51 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-5157ece4-8e07-4649-9ad1-655921defd4e tempest-VolumesExtendTest-398125600 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:22:51 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-5157ece4-8e07-4649-9ad1-655921defd4e tempest-VolumesExtendTest-398125600 None] Deleted volume successfully. Apr 28 19:22:51 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5157ece4-8e07-4649-9ad1-655921defd4e tempest-VolumesExtendTest-398125600 None] Lock "cinder-66308b20-5e26-4941-a42b-3d710390a7cc-delete_volume" released by "delete_volume" :: held 3.716s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:22:51 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-719c4690-e8ab-4e4b-b188-bd61896fcd38 tempest-VolumesExtendTest-398125600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:22:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-719c4690-e8ab-4e4b-b188-bd61896fcd38 tempest-VolumesExtendTest-398125600 None] Flow 'volume_create_manager' (b16dda2a-cad5-4ce1-8e71-bc5b3a97ef39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:22:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-719c4690-e8ab-4e4b-b188-bd61896fcd38 tempest-VolumesExtendTest-398125600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b1fa5ab-6104-4d66-93aa-ff925cca22cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-719c4690-e8ab-4e4b-b188-bd61896fcd38 tempest-VolumesExtendTest-398125600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b1fa5ab-6104-4d66-93aa-ff925cca22cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-978337615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddd4434b-bb9c-4b25-b682-1f28f3c214da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b853b9048bad42c38d178784b365495e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:22:52Z,use_quota=True,user_id='26f78cf3cb46486e8dceaf5de4247cab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-719c4690-e8ab-4e4b-b188-bd61896fcd38 tempest-VolumesExtendTest-398125600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c51b99a-83a0-4906-b39f-4423424b9cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-719c4690-e8ab-4e4b-b188-bd61896fcd38 tempest-VolumesExtendTest-398125600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c51b99a-83a0-4906-b39f-4423424b9cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-719c4690-e8ab-4e4b-b188-bd61896fcd38 tempest-VolumesExtendTest-398125600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c84cc316-b4b6-46f8-88ff-a2db7de4f37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-719c4690-e8ab-4e4b-b188-bd61896fcd38 tempest-VolumesExtendTest-398125600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c84cc316-b4b6-46f8-88ff-a2db7de4f37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddd4434b-bb9c-4b25-b682-1f28f3c214da', 'volume_name': 'volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-719c4690-e8ab-4e4b-b188-bd61896fcd38 tempest-VolumesExtendTest-398125600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37009f7f-12bb-43a0-a009-4d814a9d8735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-719c4690-e8ab-4e4b-b188-bd61896fcd38 tempest-VolumesExtendTest-398125600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37009f7f-12bb-43a0-a009-4d814a9d8735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-719c4690-e8ab-4e4b-b188-bd61896fcd38 tempest-VolumesExtendTest-398125600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e91724c4-926d-4f9b-afdd-c88a5d29a566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:51 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-719c4690-e8ab-4e4b-b188-bd61896fcd38 tempest-VolumesExtendTest-398125600 None] Volume ddd4434b-bb9c-4b25-b682-1f28f3c214da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da', 'volume_size': 1} Apr 28 19:22:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-719c4690-e8ab-4e4b-b188-bd61896fcd38 tempest-VolumesExtendTest-398125600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:22:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-719c4690-e8ab-4e4b-b188-bd61896fcd38 tempest-VolumesExtendTest-398125600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:22:51 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-719c4690-e8ab-4e4b-b188-bd61896fcd38 tempest-VolumesExtendTest-398125600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-978337615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddd4434b-bb9c-4b25-b682-1f28f3c214da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b853b9048bad42c38d178784b365495e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:22:52Z,use_quota=True,user_id='26f78cf3cb46486e8dceaf5de4247cab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:22:51 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-719c4690-e8ab-4e4b-b188-bd61896fcd38 tempest-VolumesExtendTest-398125600 None] Creating volume ddd4434b-bb9c-4b25-b682-1f28f3c214da {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:22:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-719c4690-e8ab-4e4b-b188-bd61896fcd38 tempest-VolumesExtendTest-398125600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:22:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-719c4690-e8ab-4e4b-b188-bd61896fcd38 tempest-VolumesExtendTest-398125600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:22:51 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-719c4690-e8ab-4e4b-b188-bd61896fcd38 tempest-VolumesExtendTest-398125600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:22:51 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-719c4690-e8ab-4e4b-b188-bd61896fcd38 tempest-VolumesExtendTest-398125600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:22:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-719c4690-e8ab-4e4b-b188-bd61896fcd38 tempest-VolumesExtendTest-398125600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:22:51 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-719c4690-e8ab-4e4b-b188-bd61896fcd38 tempest-VolumesExtendTest-398125600 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:22:51 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-719c4690-e8ab-4e4b-b188-bd61896fcd38 tempest-VolumesExtendTest-398125600 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:22:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-719c4690-e8ab-4e4b-b188-bd61896fcd38 tempest-VolumesExtendTest-398125600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:52 devstack sudo[91413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da 1073741824 Apr 28 19:22:52 devstack sudo[91413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:52 devstack sudo[91413]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-719c4690-e8ab-4e4b-b188-bd61896fcd38 tempest-VolumesExtendTest-398125600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da 1073741824" returned: 0 in 0.927s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-719c4690-e8ab-4e4b-b188-bd61896fcd38 tempest-VolumesExtendTest-398125600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:53 devstack sudo[91419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da Apr 28 19:22:53 devstack sudo[91419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:53 devstack sudo[91419]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-719c4690-e8ab-4e4b-b188-bd61896fcd38 tempest-VolumesExtendTest-398125600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da" returned: 0 in 0.692s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:53 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-719c4690-e8ab-4e4b-b188-bd61896fcd38 tempest-VolumesExtendTest-398125600 None] <== create_volume: return (1678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:22:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-719c4690-e8ab-4e4b-b188-bd61896fcd38 tempest-VolumesExtendTest-398125600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.681s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:22:53 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-719c4690-e8ab-4e4b-b188-bd61896fcd38 tempest-VolumesExtendTest-398125600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e91724c4-926d-4f9b-afdd-c88a5d29a566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:53 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-719c4690-e8ab-4e4b-b188-bd61896fcd38 tempest-VolumesExtendTest-398125600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2650f3c1-423a-4a4e-9790-bc1c3bcb2798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:53 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-719c4690-e8ab-4e4b-b188-bd61896fcd38 tempest-VolumesExtendTest-398125600 None] Volume volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da (ddd4434b-bb9c-4b25-b682-1f28f3c214da): created successfully Apr 28 19:22:53 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-719c4690-e8ab-4e4b-b188-bd61896fcd38 tempest-VolumesExtendTest-398125600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2650f3c1-423a-4a4e-9790-bc1c3bcb2798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:53 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-719c4690-e8ab-4e4b-b188-bd61896fcd38 tempest-VolumesExtendTest-398125600 None] Flow 'volume_create_manager' (b16dda2a-cad5-4ce1-8e71-bc5b3a97ef39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:22:53 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-719c4690-e8ab-4e4b-b188-bd61896fcd38 tempest-VolumesExtendTest-398125600 None] Created volume successfully. Apr 28 19:22:53 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-14ee3bfa-7aea-4def-b3e7-cd08ef46b0dc tempest-VolumesTransfersV357Test-1227919092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:22:53 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-14ee3bfa-7aea-4def-b3e7-cd08ef46b0dc tempest-VolumesTransfersV357Test-1227919092 None] Flow 'volume_create_manager' (8ca8f861-3317-49b3-a983-34dc7d789a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:22:53 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-14ee3bfa-7aea-4def-b3e7-cd08ef46b0dc tempest-VolumesTransfersV357Test-1227919092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1862e17-e49e-4af2-9a83-3839380f538c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:53 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-14ee3bfa-7aea-4def-b3e7-cd08ef46b0dc tempest-VolumesTransfersV357Test-1227919092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1862e17-e49e-4af2-9a83-3839380f538c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1217174267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81140423-0f7c-4bb6-8c25-20379ea6afd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6b775d9c09f44d7ad961b8c833f8f47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:22:54Z,use_quota=True,user_id='10fd503f2ae84c2db8a9c9629aaf5122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:54 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-14ee3bfa-7aea-4def-b3e7-cd08ef46b0dc tempest-VolumesTransfersV357Test-1227919092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b5a8ffc-005b-420a-895a-4a0072e95c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:54 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-14ee3bfa-7aea-4def-b3e7-cd08ef46b0dc tempest-VolumesTransfersV357Test-1227919092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b5a8ffc-005b-420a-895a-4a0072e95c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:54 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-14ee3bfa-7aea-4def-b3e7-cd08ef46b0dc tempest-VolumesTransfersV357Test-1227919092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (152b2fcf-2d7d-42ef-bb48-f6771d3a4331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:54 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-14ee3bfa-7aea-4def-b3e7-cd08ef46b0dc tempest-VolumesTransfersV357Test-1227919092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (152b2fcf-2d7d-42ef-bb48-f6771d3a4331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81140423-0f7c-4bb6-8c25-20379ea6afd0', 'volume_name': 'volume-81140423-0f7c-4bb6-8c25-20379ea6afd0', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:54 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-14ee3bfa-7aea-4def-b3e7-cd08ef46b0dc tempest-VolumesTransfersV357Test-1227919092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0dc935b-2504-4165-8b38-444d278996e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:54 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-14ee3bfa-7aea-4def-b3e7-cd08ef46b0dc tempest-VolumesTransfersV357Test-1227919092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0dc935b-2504-4165-8b38-444d278996e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:54 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-14ee3bfa-7aea-4def-b3e7-cd08ef46b0dc tempest-VolumesTransfersV357Test-1227919092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fca9893e-3d59-4112-9df7-80b456e4d5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:54 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-14ee3bfa-7aea-4def-b3e7-cd08ef46b0dc tempest-VolumesTransfersV357Test-1227919092 None] Volume 81140423-0f7c-4bb6-8c25-20379ea6afd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81140423-0f7c-4bb6-8c25-20379ea6afd0', 'volume_size': 1} Apr 28 19:22:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-14ee3bfa-7aea-4def-b3e7-cd08ef46b0dc tempest-VolumesTransfersV357Test-1227919092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:22:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-14ee3bfa-7aea-4def-b3e7-cd08ef46b0dc tempest-VolumesTransfersV357Test-1227919092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:22:54 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-14ee3bfa-7aea-4def-b3e7-cd08ef46b0dc tempest-VolumesTransfersV357Test-1227919092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1217174267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81140423-0f7c-4bb6-8c25-20379ea6afd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6b775d9c09f44d7ad961b8c833f8f47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:22:54Z,use_quota=True,user_id='10fd503f2ae84c2db8a9c9629aaf5122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:22:54 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-14ee3bfa-7aea-4def-b3e7-cd08ef46b0dc tempest-VolumesTransfersV357Test-1227919092 None] Creating volume 81140423-0f7c-4bb6-8c25-20379ea6afd0 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:22:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-14ee3bfa-7aea-4def-b3e7-cd08ef46b0dc tempest-VolumesTransfersV357Test-1227919092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:22:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-14ee3bfa-7aea-4def-b3e7-cd08ef46b0dc tempest-VolumesTransfersV357Test-1227919092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:22:54 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-14ee3bfa-7aea-4def-b3e7-cd08ef46b0dc tempest-VolumesTransfersV357Test-1227919092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:22:54 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-14ee3bfa-7aea-4def-b3e7-cd08ef46b0dc tempest-VolumesTransfersV357Test-1227919092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:22:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-14ee3bfa-7aea-4def-b3e7-cd08ef46b0dc tempest-VolumesTransfersV357Test-1227919092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:22:54 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-14ee3bfa-7aea-4def-b3e7-cd08ef46b0dc tempest-VolumesTransfersV357Test-1227919092 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:22:54 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-14ee3bfa-7aea-4def-b3e7-cd08ef46b0dc tempest-VolumesTransfersV357Test-1227919092 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:22:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-14ee3bfa-7aea-4def-b3e7-cd08ef46b0dc tempest-VolumesTransfersV357Test-1227919092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-81140423-0f7c-4bb6-8c25-20379ea6afd0 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:54 devstack sudo[91422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-81140423-0f7c-4bb6-8c25-20379ea6afd0 1073741824 Apr 28 19:22:54 devstack sudo[91422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-91a6d3a1-3bea-4fdf-a5df-964c586d23ff tempest-VolumesExtendTest-398125600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:22:54 devstack sudo[91422]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-14ee3bfa-7aea-4def-b3e7-cd08ef46b0dc tempest-VolumesTransfersV357Test-1227919092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-81140423-0f7c-4bb6-8c25-20379ea6afd0 1073741824" returned: 0 in 0.866s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-14ee3bfa-7aea-4def-b3e7-cd08ef46b0dc tempest-VolumesTransfersV357Test-1227919092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-81140423-0f7c-4bb6-8c25-20379ea6afd0 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:54 devstack sudo[91428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-81140423-0f7c-4bb6-8c25-20379ea6afd0 Apr 28 19:22:54 devstack sudo[91428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:55 devstack sudo[91428]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-14ee3bfa-7aea-4def-b3e7-cd08ef46b0dc tempest-VolumesTransfersV357Test-1227919092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-81140423-0f7c-4bb6-8c25-20379ea6afd0" returned: 0 in 0.723s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:55 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-14ee3bfa-7aea-4def-b3e7-cd08ef46b0dc tempest-VolumesTransfersV357Test-1227919092 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:22:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-14ee3bfa-7aea-4def-b3e7-cd08ef46b0dc tempest-VolumesTransfersV357Test-1227919092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.636s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:22:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-91a6d3a1-3bea-4fdf-a5df-964c586d23ff tempest-VolumesExtendTest-398125600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.464s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:22:55 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-14ee3bfa-7aea-4def-b3e7-cd08ef46b0dc tempest-VolumesTransfersV357Test-1227919092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fca9893e-3d59-4112-9df7-80b456e4d5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81140423-0f7c-4bb6-8c25-20379ea6afd0', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:55 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-14ee3bfa-7aea-4def-b3e7-cd08ef46b0dc tempest-VolumesTransfersV357Test-1227919092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bc5f772-4c9d-42ce-a4a4-8d7075ca06af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:55 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-91a6d3a1-3bea-4fdf-a5df-964c586d23ff tempest-VolumesExtendTest-398125600 None] Creating offline snapshot 1f4c57b4-d8bc-42d0-8397-cbc0eb232390 of volume ddd4434b-bb9c-4b25-b682-1f28f3c214da {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 19:22:55 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-14ee3bfa-7aea-4def-b3e7-cd08ef46b0dc tempest-VolumesTransfersV357Test-1227919092 None] Volume volume-81140423-0f7c-4bb6-8c25-20379ea6afd0 (81140423-0f7c-4bb6-8c25-20379ea6afd0): created successfully Apr 28 19:22:55 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-14ee3bfa-7aea-4def-b3e7-cd08ef46b0dc tempest-VolumesTransfersV357Test-1227919092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bc5f772-4c9d-42ce-a4a4-8d7075ca06af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:55 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-14ee3bfa-7aea-4def-b3e7-cd08ef46b0dc tempest-VolumesTransfersV357Test-1227919092 None] Flow 'volume_create_manager' (8ca8f861-3317-49b3-a983-34dc7d789a2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:22:55 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[030b0d83-2de4-4c08-9202-e6a96cc5fcd0]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:22:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-91a6d3a1-3bea-4fdf-a5df-964c586d23ff tempest-VolumesExtendTest-398125600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:55 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-14ee3bfa-7aea-4def-b3e7-cd08ef46b0dc tempest-VolumesTransfersV357Test-1227919092 None] Created volume successfully. Apr 28 19:22:55 devstack sudo[91431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da Apr 28 19:22:55 devstack sudo[91431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:56 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-58dae204-040c-4763-beda-20ffc936a2af tempest-VolumesSnapshotTestJSON-389413737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:22:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-58dae204-040c-4763-beda-20ffc936a2af tempest-VolumesSnapshotTestJSON-389413737 None] Flow 'volume_create_manager' (c9c72e78-34b4-4d47-a4b5-e0b517c48277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:22:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-58dae204-040c-4763-beda-20ffc936a2af tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bf5e40b-d90d-43b2-890c-0f554b663d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-58dae204-040c-4763-beda-20ffc936a2af tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bf5e40b-d90d-43b2-890c-0f554b663d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1755978823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b5d447a-818e-4a94-944c-77831dcb91f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcd7eac94c09403f92b066b388f6d053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:22:56Z,use_quota=True,user_id='57349484d0c543c39251044039afccea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-58dae204-040c-4763-beda-20ffc936a2af tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6894242c-e409-4349-838d-d9fe12331c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-58dae204-040c-4763-beda-20ffc936a2af tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6894242c-e409-4349-838d-d9fe12331c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-58dae204-040c-4763-beda-20ffc936a2af tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02067e92-e297-4ebb-9451-37282e2fae5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-58dae204-040c-4763-beda-20ffc936a2af tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02067e92-e297-4ebb-9451-37282e2fae5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b5d447a-818e-4a94-944c-77831dcb91f9', 'volume_name': 'volume-2b5d447a-818e-4a94-944c-77831dcb91f9', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-58dae204-040c-4763-beda-20ffc936a2af tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d968bf0d-f4b4-448d-8675-e529a74fd205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-58dae204-040c-4763-beda-20ffc936a2af tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d968bf0d-f4b4-448d-8675-e529a74fd205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:22:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-58dae204-040c-4763-beda-20ffc936a2af tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eea594b-c44b-46bb-b171-dd915daa2a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:22:56 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-58dae204-040c-4763-beda-20ffc936a2af tempest-VolumesSnapshotTestJSON-389413737 None] Volume 2b5d447a-818e-4a94-944c-77831dcb91f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b5d447a-818e-4a94-944c-77831dcb91f9', 'volume_size': 1} Apr 28 19:22:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-58dae204-040c-4763-beda-20ffc936a2af tempest-VolumesSnapshotTestJSON-389413737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:22:56 devstack sudo[91431]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-91a6d3a1-3bea-4fdf-a5df-964c586d23ff tempest-VolumesExtendTest-398125600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da" returned: 0 in 0.767s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-91a6d3a1-3bea-4fdf-a5df-964c586d23ff tempest-VolumesExtendTest-398125600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da.1f4c57b4-d8bc-42d0-8397-cbc0eb232390 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:56 devstack sudo[91437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da.1f4c57b4-d8bc-42d0-8397-cbc0eb232390 1G Apr 28 19:22:56 devstack sudo[91437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:56 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-4ee03376-ea21-456a-a27c-4752ad5b0d81 tempest-VolumesTransfersV357Test-1535913836 None] Transfer volume completed successfully. Apr 28 19:22:57 devstack sudo[91437]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-91a6d3a1-3bea-4fdf-a5df-964c586d23ff tempest-VolumesExtendTest-398125600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da.1f4c57b4-d8bc-42d0-8397-cbc0eb232390 1G" returned: 0 in 0.755s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-91a6d3a1-3bea-4fdf-a5df-964c586d23ff tempest-VolumesExtendTest-398125600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da.1f4c57b4-d8bc-42d0-8397-cbc0eb232390 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:57 devstack sudo[91443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da.1f4c57b4-d8bc-42d0-8397-cbc0eb232390 Apr 28 19:22:57 devstack sudo[91443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:57 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7529bf94-7d17-4092-a53b-ad9f2eb38aa2 tempest-VolumesTransfersV357Test-711711606 None] Acquiring lock "cinder-81140423-0f7c-4bb6-8c25-20379ea6afd0-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:22:57 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7529bf94-7d17-4092-a53b-ad9f2eb38aa2 tempest-VolumesTransfersV357Test-711711606 None] Lock "cinder-81140423-0f7c-4bb6-8c25-20379ea6afd0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:22:57 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7529bf94-7d17-4092-a53b-ad9f2eb38aa2 tempest-VolumesTransfersV357Test-711711606 None] Acquiring lock "cinder-quobyte-81140423-0f7c-4bb6-8c25-20379ea6afd0" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:22:57 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7529bf94-7d17-4092-a53b-ad9f2eb38aa2 tempest-VolumesTransfersV357Test-711711606 None] Lock "cinder-quobyte-81140423-0f7c-4bb6-8c25-20379ea6afd0" acquired by "delete_volume" :: waited 0.015s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:22:57 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e797930f-da61-4b89-9142-611573857a26]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:22:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7529bf94-7d17-4092-a53b-ad9f2eb38aa2 tempest-VolumesTransfersV357Test-711711606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-81140423-0f7c-4bb6-8c25-20379ea6afd0 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:57 devstack sudo[91445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-81140423-0f7c-4bb6-8c25-20379ea6afd0 Apr 28 19:22:57 devstack sudo[91445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:57 devstack sudo[91443]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-91a6d3a1-3bea-4fdf-a5df-964c586d23ff tempest-VolumesExtendTest-398125600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da.1f4c57b4-d8bc-42d0-8397-cbc0eb232390" returned: 0 in 0.727s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:57 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-91a6d3a1-3bea-4fdf-a5df-964c586d23ff tempest-VolumesExtendTest-398125600 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da.1f4c57b4-d8bc-42d0-8397-cbc0eb232390 is being set with open permissions: ugo+rw Apr 28 19:22:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-91a6d3a1-3bea-4fdf-a5df-964c586d23ff tempest-VolumesExtendTest-398125600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da.1f4c57b4-d8bc-42d0-8397-cbc0eb232390 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:58 devstack sudo[91450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da.1f4c57b4-d8bc-42d0-8397-cbc0eb232390 Apr 28 19:22:58 devstack sudo[91450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:58 devstack sudo[91445]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7529bf94-7d17-4092-a53b-ad9f2eb38aa2 tempest-VolumesTransfersV357Test-711711606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-81140423-0f7c-4bb6-8c25-20379ea6afd0" returned: 0 in 0.742s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7529bf94-7d17-4092-a53b-ad9f2eb38aa2 tempest-VolumesTransfersV357Test-711711606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-81140423-0f7c-4bb6-8c25-20379ea6afd0 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:58 devstack sudo[91455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-81140423-0f7c-4bb6-8c25-20379ea6afd0 Apr 28 19:22:58 devstack sudo[91455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:58 devstack sudo[91450]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-91a6d3a1-3bea-4fdf-a5df-964c586d23ff tempest-VolumesExtendTest-398125600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da.1f4c57b4-d8bc-42d0-8397-cbc0eb232390" returned: 0 in 0.634s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-91a6d3a1-3bea-4fdf-a5df-964c586d23ff tempest-VolumesExtendTest-398125600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:58 devstack sudo[91458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da.info Apr 28 19:22:58 devstack sudo[91458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:59 devstack sudo[91455]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7529bf94-7d17-4092-a53b-ad9f2eb38aa2 tempest-VolumesTransfersV357Test-711711606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-81140423-0f7c-4bb6-8c25-20379ea6afd0" returned: 0 in 0.637s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:59 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7529bf94-7d17-4092-a53b-ad9f2eb38aa2 tempest-VolumesTransfersV357Test-711711606 None] Lock "cinder-quobyte-81140423-0f7c-4bb6-8c25-20379ea6afd0" released by "delete_volume" :: held 1.426s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:22:59 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-7529bf94-7d17-4092-a53b-ad9f2eb38aa2 tempest-VolumesTransfersV357Test-711711606 None] Created reservations ['974d2b84-10cd-4b2b-b883-ec62c664e5ea', 'ca7e8758-86d8-4442-9e71-461f60e5a0eb', '856640c0-9f59-4fde-bcaa-f6bfc268509c', '09532ab8-bbb2-49da-859d-c8ae55c74768'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:22:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7529bf94-7d17-4092-a53b-ad9f2eb38aa2 tempest-VolumesTransfersV357Test-711711606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:22:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7529bf94-7d17-4092-a53b-ad9f2eb38aa2 tempest-VolumesTransfersV357Test-711711606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:22:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7529bf94-7d17-4092-a53b-ad9f2eb38aa2 tempest-VolumesTransfersV357Test-711711606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:22:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7529bf94-7d17-4092-a53b-ad9f2eb38aa2 tempest-VolumesTransfersV357Test-711711606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:22:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7529bf94-7d17-4092-a53b-ad9f2eb38aa2 tempest-VolumesTransfersV357Test-711711606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:22:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7529bf94-7d17-4092-a53b-ad9f2eb38aa2 tempest-VolumesTransfersV357Test-711711606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:59 devstack sudo[91461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:22:59 devstack sudo[91461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:59 devstack sudo[91458]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-91a6d3a1-3bea-4fdf-a5df-964c586d23ff tempest-VolumesExtendTest-398125600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da.info" returned: 0 in 0.653s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:59 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-91a6d3a1-3bea-4fdf-a5df-964c586d23ff tempest-VolumesExtendTest-398125600 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da.info is being set with open permissions: ugo+rw Apr 28 19:22:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-91a6d3a1-3bea-4fdf-a5df-964c586d23ff tempest-VolumesExtendTest-398125600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:59 devstack sudo[91464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da.info Apr 28 19:22:59 devstack sudo[91464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:59 devstack sudo[91461]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7529bf94-7d17-4092-a53b-ad9f2eb38aa2 tempest-VolumesTransfersV357Test-711711606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.621s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:59 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-7529bf94-7d17-4092-a53b-ad9f2eb38aa2 tempest-VolumesTransfersV357Test-711711606 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:22:59 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-7529bf94-7d17-4092-a53b-ad9f2eb38aa2 tempest-VolumesTransfersV357Test-711711606 None] Deleted volume successfully. Apr 28 19:22:59 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7529bf94-7d17-4092-a53b-ad9f2eb38aa2 tempest-VolumesTransfersV357Test-711711606 None] Lock "cinder-81140423-0f7c-4bb6-8c25-20379ea6afd0-delete_volume" released by "delete_volume" :: held 2.255s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:22:59 devstack sudo[91464]: pam_unix(sudo:session): session closed for user root Apr 28 19:22:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-91a6d3a1-3bea-4fdf-a5df-964c586d23ff tempest-VolumesExtendTest-398125600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da.info" returned: 0 in 0.592s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:22:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-91a6d3a1-3bea-4fdf-a5df-964c586d23ff tempest-VolumesExtendTest-398125600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.256s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:22:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-58dae204-040c-4763-beda-20ffc936a2af tempest-VolumesSnapshotTestJSON-389413737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.523s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:22:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-58dae204-040c-4763-beda-20ffc936a2af tempest-VolumesSnapshotTestJSON-389413737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1755978823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b5d447a-818e-4a94-944c-77831dcb91f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcd7eac94c09403f92b066b388f6d053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:22:56Z,use_quota=True,user_id='57349484d0c543c39251044039afccea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:22:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-58dae204-040c-4763-beda-20ffc936a2af tempest-VolumesSnapshotTestJSON-389413737 None] Creating volume 2b5d447a-818e-4a94-944c-77831dcb91f9 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:22:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-58dae204-040c-4763-beda-20ffc936a2af tempest-VolumesSnapshotTestJSON-389413737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:22:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-58dae204-040c-4763-beda-20ffc936a2af tempest-VolumesSnapshotTestJSON-389413737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:22:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-58dae204-040c-4763-beda-20ffc936a2af tempest-VolumesSnapshotTestJSON-389413737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:22:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-58dae204-040c-4763-beda-20ffc936a2af tempest-VolumesSnapshotTestJSON-389413737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:22:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-58dae204-040c-4763-beda-20ffc936a2af tempest-VolumesSnapshotTestJSON-389413737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:22:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-58dae204-040c-4763-beda-20ffc936a2af tempest-VolumesSnapshotTestJSON-389413737 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:22:59 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-58dae204-040c-4763-beda-20ffc936a2af tempest-VolumesSnapshotTestJSON-389413737 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:22:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-58dae204-040c-4763-beda-20ffc936a2af tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2b5d447a-818e-4a94-944c-77831dcb91f9 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:22:59 devstack sudo[91468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2b5d447a-818e-4a94-944c-77831dcb91f9 1073741824 Apr 28 19:22:59 devstack sudo[91468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:22:59 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-91a6d3a1-3bea-4fdf-a5df-964c586d23ff tempest-VolumesExtendTest-398125600 None] Create snapshot completed successfully Apr 28 19:23:00 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c1d44ef-90ce-45ed-aad4-a6a6231184c6 tempest-VolumesTransfersV357Test-1227919092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:23:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9c1d44ef-90ce-45ed-aad4-a6a6231184c6 tempest-VolumesTransfersV357Test-1227919092 None] Flow 'volume_create_manager' (963a6469-f12f-4be4-a6f4-c4b98e1bf618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:23:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9c1d44ef-90ce-45ed-aad4-a6a6231184c6 tempest-VolumesTransfersV357Test-1227919092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4640a5f2-61a3-4121-8117-ad7fac33d480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9c1d44ef-90ce-45ed-aad4-a6a6231184c6 tempest-VolumesTransfersV357Test-1227919092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4640a5f2-61a3-4121-8117-ad7fac33d480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:23:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-607632794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6b3cd5a-9d81-4b36-9372-e415773c799e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6b775d9c09f44d7ad961b8c833f8f47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:23:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:23:00Z,use_quota=True,user_id='10fd503f2ae84c2db8a9c9629aaf5122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9c1d44ef-90ce-45ed-aad4-a6a6231184c6 tempest-VolumesTransfersV357Test-1227919092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3f880a3-6715-4eff-b52d-b4a0d3084b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9c1d44ef-90ce-45ed-aad4-a6a6231184c6 tempest-VolumesTransfersV357Test-1227919092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3f880a3-6715-4eff-b52d-b4a0d3084b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9c1d44ef-90ce-45ed-aad4-a6a6231184c6 tempest-VolumesTransfersV357Test-1227919092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36e65e66-e10b-4eae-9570-0ea3612c5412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9c1d44ef-90ce-45ed-aad4-a6a6231184c6 tempest-VolumesTransfersV357Test-1227919092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36e65e66-e10b-4eae-9570-0ea3612c5412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6b3cd5a-9d81-4b36-9372-e415773c799e', 'volume_name': 'volume-c6b3cd5a-9d81-4b36-9372-e415773c799e', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9c1d44ef-90ce-45ed-aad4-a6a6231184c6 tempest-VolumesTransfersV357Test-1227919092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aa45feb-ce72-4d1f-8c2f-bef6ca58393c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9c1d44ef-90ce-45ed-aad4-a6a6231184c6 tempest-VolumesTransfersV357Test-1227919092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aa45feb-ce72-4d1f-8c2f-bef6ca58393c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9c1d44ef-90ce-45ed-aad4-a6a6231184c6 tempest-VolumesTransfersV357Test-1227919092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95bbdd94-aa59-408c-b5fd-eb93b0903dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:00 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-9c1d44ef-90ce-45ed-aad4-a6a6231184c6 tempest-VolumesTransfersV357Test-1227919092 None] Volume c6b3cd5a-9d81-4b36-9372-e415773c799e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6b3cd5a-9d81-4b36-9372-e415773c799e', 'volume_size': 1} Apr 28 19:23:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9c1d44ef-90ce-45ed-aad4-a6a6231184c6 tempest-VolumesTransfersV357Test-1227919092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:23:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-bfc81da9-ec5e-46a5-a4ab-12b2d75788a1 tempest-VolumesExtendTest-398125600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:23:00 devstack sudo[91468]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-58dae204-040c-4763-beda-20ffc936a2af tempest-VolumesSnapshotTestJSON-389413737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2b5d447a-818e-4a94-944c-77831dcb91f9 1073741824" returned: 0 in 0.814s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-58dae204-040c-4763-beda-20ffc936a2af tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2b5d447a-818e-4a94-944c-77831dcb91f9 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:00 devstack sudo[91475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2b5d447a-818e-4a94-944c-77831dcb91f9 Apr 28 19:23:00 devstack sudo[91475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:01 devstack sudo[91475]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-58dae204-040c-4763-beda-20ffc936a2af tempest-VolumesSnapshotTestJSON-389413737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2b5d447a-818e-4a94-944c-77831dcb91f9" returned: 0 in 0.615s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:01 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-58dae204-040c-4763-beda-20ffc936a2af tempest-VolumesSnapshotTestJSON-389413737 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:23:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-58dae204-040c-4763-beda-20ffc936a2af tempest-VolumesSnapshotTestJSON-389413737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.471s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:23:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9c1d44ef-90ce-45ed-aad4-a6a6231184c6 tempest-VolumesTransfersV357Test-1227919092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.049s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:23:01 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-9c1d44ef-90ce-45ed-aad4-a6a6231184c6 tempest-VolumesTransfersV357Test-1227919092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:23:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-607632794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6b3cd5a-9d81-4b36-9372-e415773c799e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6b775d9c09f44d7ad961b8c833f8f47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:23:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:23:00Z,use_quota=True,user_id='10fd503f2ae84c2db8a9c9629aaf5122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:23:01 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-9c1d44ef-90ce-45ed-aad4-a6a6231184c6 tempest-VolumesTransfersV357Test-1227919092 None] Creating volume c6b3cd5a-9d81-4b36-9372-e415773c799e {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:23:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9c1d44ef-90ce-45ed-aad4-a6a6231184c6 tempest-VolumesTransfersV357Test-1227919092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:23:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9c1d44ef-90ce-45ed-aad4-a6a6231184c6 tempest-VolumesTransfersV357Test-1227919092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:23:01 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-9c1d44ef-90ce-45ed-aad4-a6a6231184c6 tempest-VolumesTransfersV357Test-1227919092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:23:01 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-9c1d44ef-90ce-45ed-aad4-a6a6231184c6 tempest-VolumesTransfersV357Test-1227919092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:23:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9c1d44ef-90ce-45ed-aad4-a6a6231184c6 tempest-VolumesTransfersV357Test-1227919092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:23:01 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-9c1d44ef-90ce-45ed-aad4-a6a6231184c6 tempest-VolumesTransfersV357Test-1227919092 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:23:01 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-9c1d44ef-90ce-45ed-aad4-a6a6231184c6 tempest-VolumesTransfersV357Test-1227919092 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:23:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9c1d44ef-90ce-45ed-aad4-a6a6231184c6 tempest-VolumesTransfersV357Test-1227919092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c6b3cd5a-9d81-4b36-9372-e415773c799e 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-58dae204-040c-4763-beda-20ffc936a2af tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eea594b-c44b-46bb-b171-dd915daa2a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b5d447a-818e-4a94-944c-77831dcb91f9', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:01 devstack sudo[91478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c6b3cd5a-9d81-4b36-9372-e415773c799e 1073741824 Apr 28 19:23:01 devstack sudo[91478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-58dae204-040c-4763-beda-20ffc936a2af tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (822f84fd-68c9-46be-b0bb-72eea9129773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:01 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-58dae204-040c-4763-beda-20ffc936a2af tempest-VolumesSnapshotTestJSON-389413737 None] Volume volume-2b5d447a-818e-4a94-944c-77831dcb91f9 (2b5d447a-818e-4a94-944c-77831dcb91f9): created successfully Apr 28 19:23:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-58dae204-040c-4763-beda-20ffc936a2af tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (822f84fd-68c9-46be-b0bb-72eea9129773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-58dae204-040c-4763-beda-20ffc936a2af tempest-VolumesSnapshotTestJSON-389413737 None] Flow 'volume_create_manager' (c9c72e78-34b4-4d47-a4b5-e0b517c48277) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:23:01 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-58dae204-040c-4763-beda-20ffc936a2af tempest-VolumesSnapshotTestJSON-389413737 None] Created volume successfully. Apr 28 19:23:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b17f2fa5-e575-48c9-acca-7c9cec7e6795 tempest-VolumesSnapshotTestJSON-389413737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:23:02 devstack sudo[91478]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9c1d44ef-90ce-45ed-aad4-a6a6231184c6 tempest-VolumesTransfersV357Test-1227919092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c6b3cd5a-9d81-4b36-9372-e415773c799e 1073741824" returned: 0 in 0.770s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9c1d44ef-90ce-45ed-aad4-a6a6231184c6 tempest-VolumesTransfersV357Test-1227919092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c6b3cd5a-9d81-4b36-9372-e415773c799e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:02 devstack sudo[91483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c6b3cd5a-9d81-4b36-9372-e415773c799e Apr 28 19:23:02 devstack sudo[91483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:02 devstack sudo[91483]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9c1d44ef-90ce-45ed-aad4-a6a6231184c6 tempest-VolumesTransfersV357Test-1227919092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c6b3cd5a-9d81-4b36-9372-e415773c799e" returned: 0 in 0.617s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:02 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-9c1d44ef-90ce-45ed-aad4-a6a6231184c6 tempest-VolumesTransfersV357Test-1227919092 None] <== create_volume: return (1424ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:23:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9c1d44ef-90ce-45ed-aad4-a6a6231184c6 tempest-VolumesTransfersV357Test-1227919092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.428s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:23:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-bfc81da9-ec5e-46a5-a4ab-12b2d75788a1 tempest-VolumesExtendTest-398125600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.197s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:23:02 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a0028d-aad9-4717-841f-1475d90b46e4]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:23:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bfc81da9-ec5e-46a5-a4ab-12b2d75788a1 tempest-VolumesExtendTest-398125600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9c1d44ef-90ce-45ed-aad4-a6a6231184c6 tempest-VolumesTransfersV357Test-1227919092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95bbdd94-aa59-408c-b5fd-eb93b0903dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6b3cd5a-9d81-4b36-9372-e415773c799e', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9c1d44ef-90ce-45ed-aad4-a6a6231184c6 tempest-VolumesTransfersV357Test-1227919092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34e3f19d-9129-4c7f-a196-88ee9291f3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:02 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-9c1d44ef-90ce-45ed-aad4-a6a6231184c6 tempest-VolumesTransfersV357Test-1227919092 None] Volume volume-c6b3cd5a-9d81-4b36-9372-e415773c799e (c6b3cd5a-9d81-4b36-9372-e415773c799e): created successfully Apr 28 19:23:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9c1d44ef-90ce-45ed-aad4-a6a6231184c6 tempest-VolumesTransfersV357Test-1227919092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34e3f19d-9129-4c7f-a196-88ee9291f3a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9c1d44ef-90ce-45ed-aad4-a6a6231184c6 tempest-VolumesTransfersV357Test-1227919092 None] Flow 'volume_create_manager' (963a6469-f12f-4be4-a6f4-c4b98e1bf618) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:23:02 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-9c1d44ef-90ce-45ed-aad4-a6a6231184c6 tempest-VolumesTransfersV357Test-1227919092 None] Created volume successfully. Apr 28 19:23:02 devstack sudo[91486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da Apr 28 19:23:02 devstack sudo[91486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:03 devstack cinder-volume[83863]: DEBUG oslo_service.periodic_task [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 28 19:23:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:23:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:23:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:23:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:23:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:23:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:03 devstack sudo[91488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:23:03 devstack sudo[91488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:03 devstack sudo[91486]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bfc81da9-ec5e-46a5-a4ab-12b2d75788a1 tempest-VolumesExtendTest-398125600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da" returned: 0 in 0.761s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bfc81da9-ec5e-46a5-a4ab-12b2d75788a1 tempest-VolumesExtendTest-398125600 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da.1f4c57b4-d8bc-42d0-8397-cbc0eb232390 2G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4ca37959-0e96-4150-9a25-6dfc63db53d5 tempest-VolumesTransfersV357Test-711711606 None] Acquiring lock "cinder-c6b3cd5a-9d81-4b36-9372-e415773c799e-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:23:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bfc81da9-ec5e-46a5-a4ab-12b2d75788a1 tempest-VolumesExtendTest-398125600 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da.1f4c57b4-d8bc-42d0-8397-cbc0eb232390 2G" returned: 0 in 0.174s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-bfc81da9-ec5e-46a5-a4ab-12b2d75788a1 tempest-VolumesExtendTest-398125600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.968s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:23:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b17f2fa5-e575-48c9-acca-7c9cec7e6795 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.890s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:23:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4ca37959-0e96-4150-9a25-6dfc63db53d5 tempest-VolumesTransfersV357Test-711711606 None] Lock "cinder-c6b3cd5a-9d81-4b36-9372-e415773c799e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:23:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-b17f2fa5-e575-48c9-acca-7c9cec7e6795 tempest-VolumesSnapshotTestJSON-389413737 None] Creating offline snapshot 8b15cc3c-a864-40c0-9e94-b8ab24730b93 of volume 2b5d447a-818e-4a94-944c-77831dcb91f9 {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 19:23:03 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc891c6f-72d5-4ca6-a645-e181cc927088]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:23:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b17f2fa5-e575-48c9-acca-7c9cec7e6795 tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2b5d447a-818e-4a94-944c-77831dcb91f9 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:03 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-bfc81da9-ec5e-46a5-a4ab-12b2d75788a1 tempest-VolumesExtendTest-398125600 None] Extend volume completed successfully. Apr 28 19:23:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4ca37959-0e96-4150-9a25-6dfc63db53d5 tempest-VolumesTransfersV357Test-711711606 None] Acquiring lock "cinder-quobyte-c6b3cd5a-9d81-4b36-9372-e415773c799e" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:23:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4ca37959-0e96-4150-9a25-6dfc63db53d5 tempest-VolumesTransfersV357Test-711711606 None] Lock "cinder-quobyte-c6b3cd5a-9d81-4b36-9372-e415773c799e" acquired by "delete_volume" :: waited 0.017s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:23:03 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8352cd-107e-4faa-9beb-e4c89a2ef8d0]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:23:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4ca37959-0e96-4150-9a25-6dfc63db53d5 tempest-VolumesTransfersV357Test-711711606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c6b3cd5a-9d81-4b36-9372-e415773c799e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:04 devstack sudo[91497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2b5d447a-818e-4a94-944c-77831dcb91f9 Apr 28 19:23:04 devstack sudo[91497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:04 devstack sudo[91488]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.663s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:04 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:23:04 devstack sudo[91499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c6b3cd5a-9d81-4b36-9372-e415773c799e Apr 28 19:23:04 devstack sudo[91499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:04 devstack sudo[91497]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b17f2fa5-e575-48c9-acca-7c9cec7e6795 tempest-VolumesSnapshotTestJSON-389413737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2b5d447a-818e-4a94-944c-77831dcb91f9" returned: 0 in 0.769s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b17f2fa5-e575-48c9-acca-7c9cec7e6795 tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2b5d447a-818e-4a94-944c-77831dcb91f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2b5d447a-818e-4a94-944c-77831dcb91f9.8b15cc3c-a864-40c0-9e94-b8ab24730b93 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:04 devstack sudo[91508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2b5d447a-818e-4a94-944c-77831dcb91f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2b5d447a-818e-4a94-944c-77831dcb91f9.8b15cc3c-a864-40c0-9e94-b8ab24730b93 1G Apr 28 19:23:04 devstack sudo[91508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:04 devstack sudo[91499]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4ca37959-0e96-4150-9a25-6dfc63db53d5 tempest-VolumesTransfersV357Test-711711606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c6b3cd5a-9d81-4b36-9372-e415773c799e" returned: 0 in 0.727s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4ca37959-0e96-4150-9a25-6dfc63db53d5 tempest-VolumesTransfersV357Test-711711606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c6b3cd5a-9d81-4b36-9372-e415773c799e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:04 devstack sudo[91510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c6b3cd5a-9d81-4b36-9372-e415773c799e Apr 28 19:23:04 devstack sudo[91510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:05 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d4c3cae9-9f78-4f11-887a-981deff49783 tempest-VolumesExtendTest-398125600 None] Acquiring lock "cinder-1f4c57b4-d8bc-42d0-8397-cbc0eb232390-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:23:05 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d4c3cae9-9f78-4f11-887a-981deff49783 tempest-VolumesExtendTest-398125600 None] Lock "cinder-1f4c57b4-d8bc-42d0-8397-cbc0eb232390-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:23:05 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d4c3cae9-9f78-4f11-887a-981deff49783 tempest-VolumesExtendTest-398125600 None] Acquiring lock "cinder-quobyte-ddd4434b-bb9c-4b25-b682-1f28f3c214da" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:23:05 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d4c3cae9-9f78-4f11-887a-981deff49783 tempest-VolumesExtendTest-398125600 None] Lock "cinder-quobyte-ddd4434b-bb9c-4b25-b682-1f28f3c214da" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:23:05 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d4c3cae9-9f78-4f11-887a-981deff49783 tempest-VolumesExtendTest-398125600 None] Acquiring lock "cinder-quobyte-1f4c57b4-d8bc-42d0-8397-cbc0eb232390" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:23:05 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d4c3cae9-9f78-4f11-887a-981deff49783 tempest-VolumesExtendTest-398125600 None] Lock "cinder-quobyte-1f4c57b4-d8bc-42d0-8397-cbc0eb232390" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:23:05 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-d4c3cae9-9f78-4f11-887a-981deff49783 tempest-VolumesExtendTest-398125600 None] Deleting offline snapshot 1f4c57b4-d8bc-42d0-8397-cbc0eb232390 of volume ddd4434b-bb9c-4b25-b682-1f28f3c214da {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 19:23:05 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-d4c3cae9-9f78-4f11-887a-981deff49783 tempest-VolumesExtendTest-398125600 None] snapshot_file for this snap is: volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da.1f4c57b4-d8bc-42d0-8397-cbc0eb232390 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 19:23:05 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[595b6d87-fd5f-41c0-9a86-b22391e22ae2]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:23:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d4c3cae9-9f78-4f11-887a-981deff49783 tempest-VolumesExtendTest-398125600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da.1f4c57b4-d8bc-42d0-8397-cbc0eb232390 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:05 devstack sudo[91515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da.1f4c57b4-d8bc-42d0-8397-cbc0eb232390 Apr 28 19:23:05 devstack sudo[91515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:05 devstack sudo[91510]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4ca37959-0e96-4150-9a25-6dfc63db53d5 tempest-VolumesTransfersV357Test-711711606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c6b3cd5a-9d81-4b36-9372-e415773c799e" returned: 0 in 0.656s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:05 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4ca37959-0e96-4150-9a25-6dfc63db53d5 tempest-VolumesTransfersV357Test-711711606 None] Lock "cinder-quobyte-c6b3cd5a-9d81-4b36-9372-e415773c799e" released by "delete_volume" :: held 1.442s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:23:05 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-4ca37959-0e96-4150-9a25-6dfc63db53d5 tempest-VolumesTransfersV357Test-711711606 None] Created reservations ['985e260b-fa84-49ec-8f7a-e0d6c54405c2', 'c7ef1651-6148-4ec8-a0ad-3188dd2bf5a9', 'ea382207-24df-40f7-8445-f79a5022260a', '693741e3-7caf-4943-9d5a-085a83911a64'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:23:05 devstack sudo[91508]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b17f2fa5-e575-48c9-acca-7c9cec7e6795 tempest-VolumesSnapshotTestJSON-389413737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2b5d447a-818e-4a94-944c-77831dcb91f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2b5d447a-818e-4a94-944c-77831dcb91f9.8b15cc3c-a864-40c0-9e94-b8ab24730b93 1G" returned: 0 in 0.782s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b17f2fa5-e575-48c9-acca-7c9cec7e6795 tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b5d447a-818e-4a94-944c-77831dcb91f9 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2b5d447a-818e-4a94-944c-77831dcb91f9.8b15cc3c-a864-40c0-9e94-b8ab24730b93 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:05 devstack sudo[91519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b5d447a-818e-4a94-944c-77831dcb91f9 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2b5d447a-818e-4a94-944c-77831dcb91f9.8b15cc3c-a864-40c0-9e94-b8ab24730b93 Apr 28 19:23:05 devstack sudo[91519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4ca37959-0e96-4150-9a25-6dfc63db53d5 tempest-VolumesTransfersV357Test-711711606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:23:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4ca37959-0e96-4150-9a25-6dfc63db53d5 tempest-VolumesTransfersV357Test-711711606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:23:05 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4ca37959-0e96-4150-9a25-6dfc63db53d5 tempest-VolumesTransfersV357Test-711711606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:23:05 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4ca37959-0e96-4150-9a25-6dfc63db53d5 tempest-VolumesTransfersV357Test-711711606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:23:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4ca37959-0e96-4150-9a25-6dfc63db53d5 tempest-VolumesTransfersV357Test-711711606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:23:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4ca37959-0e96-4150-9a25-6dfc63db53d5 tempest-VolumesTransfersV357Test-711711606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:05 devstack sudo[91521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:23:05 devstack sudo[91521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:05 devstack sudo[91515]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d4c3cae9-9f78-4f11-887a-981deff49783 tempest-VolumesExtendTest-398125600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da.1f4c57b4-d8bc-42d0-8397-cbc0eb232390" returned: 0 in 0.753s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:05 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-d4c3cae9-9f78-4f11-887a-981deff49783 tempest-VolumesExtendTest-398125600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:23:06 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09c0d60-edf8-41bb-b86f-00f4a19d012d]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:23:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d4c3cae9-9f78-4f11-887a-981deff49783 tempest-VolumesExtendTest-398125600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:06 devstack sudo[91521]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4ca37959-0e96-4150-9a25-6dfc63db53d5 tempest-VolumesTransfersV357Test-711711606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.628s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:06 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-4ca37959-0e96-4150-9a25-6dfc63db53d5 tempest-VolumesTransfersV357Test-711711606 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:23:06 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-4ca37959-0e96-4150-9a25-6dfc63db53d5 tempest-VolumesTransfersV357Test-711711606 None] Deleted volume successfully. Apr 28 19:23:06 devstack sudo[91529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da Apr 28 19:23:06 devstack sudo[91529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:06 devstack sudo[91519]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:06 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4ca37959-0e96-4150-9a25-6dfc63db53d5 tempest-VolumesTransfersV357Test-711711606 None] Lock "cinder-c6b3cd5a-9d81-4b36-9372-e415773c799e-delete_volume" released by "delete_volume" :: held 2.363s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:23:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b17f2fa5-e575-48c9-acca-7c9cec7e6795 tempest-VolumesSnapshotTestJSON-389413737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b5d447a-818e-4a94-944c-77831dcb91f9 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2b5d447a-818e-4a94-944c-77831dcb91f9.8b15cc3c-a864-40c0-9e94-b8ab24730b93" returned: 0 in 0.748s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:06 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-b17f2fa5-e575-48c9-acca-7c9cec7e6795 tempest-VolumesSnapshotTestJSON-389413737 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2b5d447a-818e-4a94-944c-77831dcb91f9.8b15cc3c-a864-40c0-9e94-b8ab24730b93 is being set with open permissions: ugo+rw Apr 28 19:23:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b17f2fa5-e575-48c9-acca-7c9cec7e6795 tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2b5d447a-818e-4a94-944c-77831dcb91f9.8b15cc3c-a864-40c0-9e94-b8ab24730b93 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:06 devstack sudo[91532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2b5d447a-818e-4a94-944c-77831dcb91f9.8b15cc3c-a864-40c0-9e94-b8ab24730b93 Apr 28 19:23:06 devstack sudo[91532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:06 devstack sudo[91529]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d4c3cae9-9f78-4f11-887a-981deff49783 tempest-VolumesExtendTest-398125600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da" returned: 0 in 0.781s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d4c3cae9-9f78-4f11-887a-981deff49783 tempest-VolumesExtendTest-398125600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da.1f4c57b4-d8bc-42d0-8397-cbc0eb232390 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:06 devstack sudo[91538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da.1f4c57b4-d8bc-42d0-8397-cbc0eb232390 Apr 28 19:23:06 devstack sudo[91538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:06 devstack sudo[91532]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b17f2fa5-e575-48c9-acca-7c9cec7e6795 tempest-VolumesSnapshotTestJSON-389413737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2b5d447a-818e-4a94-944c-77831dcb91f9.8b15cc3c-a864-40c0-9e94-b8ab24730b93" returned: 0 in 0.675s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b17f2fa5-e575-48c9-acca-7c9cec7e6795 tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2b5d447a-818e-4a94-944c-77831dcb91f9.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:06 devstack sudo[91540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2b5d447a-818e-4a94-944c-77831dcb91f9.info Apr 28 19:23:06 devstack sudo[91540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:07 devstack sudo[91540]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b17f2fa5-e575-48c9-acca-7c9cec7e6795 tempest-VolumesSnapshotTestJSON-389413737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2b5d447a-818e-4a94-944c-77831dcb91f9.info" returned: 0 in 0.660s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:07 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-b17f2fa5-e575-48c9-acca-7c9cec7e6795 tempest-VolumesSnapshotTestJSON-389413737 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2b5d447a-818e-4a94-944c-77831dcb91f9.info is being set with open permissions: ugo+rw Apr 28 19:23:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b17f2fa5-e575-48c9-acca-7c9cec7e6795 tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2b5d447a-818e-4a94-944c-77831dcb91f9.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:07 devstack sudo[91547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2b5d447a-818e-4a94-944c-77831dcb91f9.info Apr 28 19:23:07 devstack sudo[91547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:07 devstack sudo[91538]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d4c3cae9-9f78-4f11-887a-981deff49783 tempest-VolumesExtendTest-398125600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da.1f4c57b4-d8bc-42d0-8397-cbc0eb232390" returned: 0 in 0.838s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d4c3cae9-9f78-4f11-887a-981deff49783 tempest-VolumesExtendTest-398125600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da.1f4c57b4-d8bc-42d0-8397-cbc0eb232390 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:07 devstack sudo[91550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da.1f4c57b4-d8bc-42d0-8397-cbc0eb232390 Apr 28 19:23:07 devstack sudo[91550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:08 devstack sudo[91547]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b17f2fa5-e575-48c9-acca-7c9cec7e6795 tempest-VolumesSnapshotTestJSON-389413737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2b5d447a-818e-4a94-944c-77831dcb91f9.info" returned: 0 in 0.728s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:08 devstack sudo[91550]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b17f2fa5-e575-48c9-acca-7c9cec7e6795 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.519s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:23:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d4c3cae9-9f78-4f11-887a-981deff49783 tempest-VolumesExtendTest-398125600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da.1f4c57b4-d8bc-42d0-8397-cbc0eb232390" returned: 0 in 0.683s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:08 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d4c3cae9-9f78-4f11-887a-981deff49783 tempest-VolumesExtendTest-398125600 None] Lock "cinder-quobyte-1f4c57b4-d8bc-42d0-8397-cbc0eb232390" released by "_delete_snapshot" :: held 3.199s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:23:08 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d4c3cae9-9f78-4f11-887a-981deff49783 tempest-VolumesExtendTest-398125600 None] Lock "cinder-quobyte-ddd4434b-bb9c-4b25-b682-1f28f3c214da" released by "delete_snapshot" :: held 3.231s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:23:08 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-b17f2fa5-e575-48c9-acca-7c9cec7e6795 tempest-VolumesSnapshotTestJSON-389413737 None] Create snapshot completed successfully Apr 28 19:23:08 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-d4c3cae9-9f78-4f11-887a-981deff49783 tempest-VolumesExtendTest-398125600 None] Created reservations ['449029aa-e5f5-4f97-b59e-f3d9cea46602', '48a540c7-516f-4c47-bf10-064bc8468179', '6d0dd414-f583-4e9d-9683-eb4d5f5b3630', '2d194fbe-caa5-4359-959f-bce0e1691b0d'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:23:08 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-d4c3cae9-9f78-4f11-887a-981deff49783 tempest-VolumesExtendTest-398125600 None] Delete snapshot completed successfully. Apr 28 19:23:08 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d4c3cae9-9f78-4f11-887a-981deff49783 tempest-VolumesExtendTest-398125600 None] Lock "cinder-1f4c57b4-d8bc-42d0-8397-cbc0eb232390-delete_snapshot" released by "delete_snapshot" :: held 3.382s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:23:09 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-04065b13-e2d7-4b5e-90a9-2b7c53d73fa8 tempest-VolumesSnapshotTestJSON-389413737 None] Acquiring lock "cinder-8b15cc3c-a864-40c0-9e94-b8ab24730b93-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:23:09 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-04065b13-e2d7-4b5e-90a9-2b7c53d73fa8 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "cinder-8b15cc3c-a864-40c0-9e94-b8ab24730b93-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:23:09 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-04065b13-e2d7-4b5e-90a9-2b7c53d73fa8 tempest-VolumesSnapshotTestJSON-389413737 None] Acquiring lock "cinder-quobyte-2b5d447a-818e-4a94-944c-77831dcb91f9" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:23:09 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-04065b13-e2d7-4b5e-90a9-2b7c53d73fa8 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "cinder-quobyte-2b5d447a-818e-4a94-944c-77831dcb91f9" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:23:09 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-04065b13-e2d7-4b5e-90a9-2b7c53d73fa8 tempest-VolumesSnapshotTestJSON-389413737 None] Acquiring lock "cinder-quobyte-8b15cc3c-a864-40c0-9e94-b8ab24730b93" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:23:09 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-04065b13-e2d7-4b5e-90a9-2b7c53d73fa8 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "cinder-quobyte-8b15cc3c-a864-40c0-9e94-b8ab24730b93" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:23:09 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-04065b13-e2d7-4b5e-90a9-2b7c53d73fa8 tempest-VolumesSnapshotTestJSON-389413737 None] Deleting offline snapshot 8b15cc3c-a864-40c0-9e94-b8ab24730b93 of volume 2b5d447a-818e-4a94-944c-77831dcb91f9 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 19:23:09 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-04065b13-e2d7-4b5e-90a9-2b7c53d73fa8 tempest-VolumesSnapshotTestJSON-389413737 None] snapshot_file for this snap is: volume-2b5d447a-818e-4a94-944c-77831dcb91f9.8b15cc3c-a864-40c0-9e94-b8ab24730b93 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 19:23:09 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-feb03dbf-9ae9-48da-b31b-6bc8d2102543 tempest-VolumesExtendTest-398125600 None] Acquiring lock "cinder-ddd4434b-bb9c-4b25-b682-1f28f3c214da-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:23:09 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc8a21f-e24a-4333-abeb-6d79c7edad43]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:23:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-04065b13-e2d7-4b5e-90a9-2b7c53d73fa8 tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2b5d447a-818e-4a94-944c-77831dcb91f9.8b15cc3c-a864-40c0-9e94-b8ab24730b93 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:09 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-feb03dbf-9ae9-48da-b31b-6bc8d2102543 tempest-VolumesExtendTest-398125600 None] Lock "cinder-ddd4434b-bb9c-4b25-b682-1f28f3c214da-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:23:09 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-feb03dbf-9ae9-48da-b31b-6bc8d2102543 tempest-VolumesExtendTest-398125600 None] Acquiring lock "cinder-quobyte-ddd4434b-bb9c-4b25-b682-1f28f3c214da" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:23:09 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-feb03dbf-9ae9-48da-b31b-6bc8d2102543 tempest-VolumesExtendTest-398125600 None] Lock "cinder-quobyte-ddd4434b-bb9c-4b25-b682-1f28f3c214da" acquired by "delete_volume" :: waited 0.018s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:23:09 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ab3475-798a-42bf-9280-ba1bebae012b]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:23:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-feb03dbf-9ae9-48da-b31b-6bc8d2102543 tempest-VolumesExtendTest-398125600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:09 devstack sudo[91554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2b5d447a-818e-4a94-944c-77831dcb91f9.8b15cc3c-a864-40c0-9e94-b8ab24730b93 Apr 28 19:23:09 devstack sudo[91554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:09 devstack sudo[91555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da Apr 28 19:23:09 devstack sudo[91555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:10 devstack sudo[91554]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-04065b13-e2d7-4b5e-90a9-2b7c53d73fa8 tempest-VolumesSnapshotTestJSON-389413737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2b5d447a-818e-4a94-944c-77831dcb91f9.8b15cc3c-a864-40c0-9e94-b8ab24730b93" returned: 0 in 0.791s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:10 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-04065b13-e2d7-4b5e-90a9-2b7c53d73fa8 tempest-VolumesSnapshotTestJSON-389413737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b5d447a-818e-4a94-944c-77831dcb91f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:23:10 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9c0bfa-e639-475f-84f2-3c4f2381b5c7]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:23:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-04065b13-e2d7-4b5e-90a9-2b7c53d73fa8 tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2b5d447a-818e-4a94-944c-77831dcb91f9 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:10 devstack sudo[91555]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-feb03dbf-9ae9-48da-b31b-6bc8d2102543 tempest-VolumesExtendTest-398125600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da" returned: 0 in 0.785s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-feb03dbf-9ae9-48da-b31b-6bc8d2102543 tempest-VolumesExtendTest-398125600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:10 devstack sudo[91565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da Apr 28 19:23:10 devstack sudo[91565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:10 devstack sudo[91564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2b5d447a-818e-4a94-944c-77831dcb91f9 Apr 28 19:23:10 devstack sudo[91564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:11 devstack sudo[91565]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-feb03dbf-9ae9-48da-b31b-6bc8d2102543 tempest-VolumesExtendTest-398125600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ddd4434b-bb9c-4b25-b682-1f28f3c214da" returned: 0 in 0.655s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:11 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-feb03dbf-9ae9-48da-b31b-6bc8d2102543 tempest-VolumesExtendTest-398125600 None] Lock "cinder-quobyte-ddd4434b-bb9c-4b25-b682-1f28f3c214da" released by "delete_volume" :: held 1.523s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:23:11 devstack sudo[91564]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-04065b13-e2d7-4b5e-90a9-2b7c53d73fa8 tempest-VolumesSnapshotTestJSON-389413737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2b5d447a-818e-4a94-944c-77831dcb91f9" returned: 0 in 0.780s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-04065b13-e2d7-4b5e-90a9-2b7c53d73fa8 tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2b5d447a-818e-4a94-944c-77831dcb91f9.8b15cc3c-a864-40c0-9e94-b8ab24730b93 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:11 devstack sudo[91573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2b5d447a-818e-4a94-944c-77831dcb91f9.8b15cc3c-a864-40c0-9e94-b8ab24730b93 Apr 28 19:23:11 devstack sudo[91573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:11 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-feb03dbf-9ae9-48da-b31b-6bc8d2102543 tempest-VolumesExtendTest-398125600 None] Created reservations ['4462e343-ba03-4fe7-8d0a-b6c1c2dd5396', '0b51d20a-f19c-451a-8602-2148d9786ef5', '7f61bedf-043e-47b4-b4a9-db0de26b7186', '0934e779-9fcc-4e7a-af1c-56d31f0ef3d2'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:23:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-feb03dbf-9ae9-48da-b31b-6bc8d2102543 tempest-VolumesExtendTest-398125600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:23:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-feb03dbf-9ae9-48da-b31b-6bc8d2102543 tempest-VolumesExtendTest-398125600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:23:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-feb03dbf-9ae9-48da-b31b-6bc8d2102543 tempest-VolumesExtendTest-398125600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:23:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-feb03dbf-9ae9-48da-b31b-6bc8d2102543 tempest-VolumesExtendTest-398125600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:23:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-feb03dbf-9ae9-48da-b31b-6bc8d2102543 tempest-VolumesExtendTest-398125600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:23:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-feb03dbf-9ae9-48da-b31b-6bc8d2102543 tempest-VolumesExtendTest-398125600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:11 devstack sudo[91575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:23:11 devstack sudo[91575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:11 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9c431d0-3ef5-431b-be39-8567b459be61 tempest-VolumeDependencyTests-448203194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:23:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b9c431d0-3ef5-431b-be39-8567b459be61 tempest-VolumeDependencyTests-448203194 None] Flow 'volume_create_manager' (5a25ed95-f36c-4c1b-aaa0-cf6a8c072080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:23:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b9c431d0-3ef5-431b-be39-8567b459be61 tempest-VolumeDependencyTests-448203194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6115c7c-3410-420c-bd05-1ebbb3649df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b9c431d0-3ef5-431b-be39-8567b459be61 tempest-VolumeDependencyTests-448203194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6115c7c-3410-420c-bd05-1ebbb3649df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2022478261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bae102d6-65a9-4f6e-8196-ab74d4503878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff619ae26a3941c3bb83a36d3a29d9da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:23:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:23:11Z,use_quota=True,user_id='7c106efa0d134538838c2a28c50746c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b9c431d0-3ef5-431b-be39-8567b459be61 tempest-VolumeDependencyTests-448203194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00804ac2-f8c1-4a10-9f4a-6ff38550b6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b9c431d0-3ef5-431b-be39-8567b459be61 tempest-VolumeDependencyTests-448203194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00804ac2-f8c1-4a10-9f4a-6ff38550b6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b9c431d0-3ef5-431b-be39-8567b459be61 tempest-VolumeDependencyTests-448203194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52ed9d22-9406-455a-834f-0500190b0905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b9c431d0-3ef5-431b-be39-8567b459be61 tempest-VolumeDependencyTests-448203194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52ed9d22-9406-455a-834f-0500190b0905) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bae102d6-65a9-4f6e-8196-ab74d4503878', 'volume_name': 'volume-bae102d6-65a9-4f6e-8196-ab74d4503878', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b9c431d0-3ef5-431b-be39-8567b459be61 tempest-VolumeDependencyTests-448203194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36e4423e-c15e-4e92-b286-be9d436207ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b9c431d0-3ef5-431b-be39-8567b459be61 tempest-VolumeDependencyTests-448203194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36e4423e-c15e-4e92-b286-be9d436207ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b9c431d0-3ef5-431b-be39-8567b459be61 tempest-VolumeDependencyTests-448203194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78131d79-44d5-4743-bcfa-e59c389f69dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:11 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-b9c431d0-3ef5-431b-be39-8567b459be61 tempest-VolumeDependencyTests-448203194 None] Volume bae102d6-65a9-4f6e-8196-ab74d4503878: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bae102d6-65a9-4f6e-8196-ab74d4503878', 'volume_size': 1} Apr 28 19:23:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b9c431d0-3ef5-431b-be39-8567b459be61 tempest-VolumeDependencyTests-448203194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:23:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b9c431d0-3ef5-431b-be39-8567b459be61 tempest-VolumeDependencyTests-448203194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:23:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b9c431d0-3ef5-431b-be39-8567b459be61 tempest-VolumeDependencyTests-448203194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2022478261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bae102d6-65a9-4f6e-8196-ab74d4503878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff619ae26a3941c3bb83a36d3a29d9da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:23:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:23:11Z,use_quota=True,user_id='7c106efa0d134538838c2a28c50746c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:23:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-b9c431d0-3ef5-431b-be39-8567b459be61 tempest-VolumeDependencyTests-448203194 None] Creating volume bae102d6-65a9-4f6e-8196-ab74d4503878 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:23:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b9c431d0-3ef5-431b-be39-8567b459be61 tempest-VolumeDependencyTests-448203194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:23:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b9c431d0-3ef5-431b-be39-8567b459be61 tempest-VolumeDependencyTests-448203194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:23:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b9c431d0-3ef5-431b-be39-8567b459be61 tempest-VolumeDependencyTests-448203194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:23:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b9c431d0-3ef5-431b-be39-8567b459be61 tempest-VolumeDependencyTests-448203194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:23:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b9c431d0-3ef5-431b-be39-8567b459be61 tempest-VolumeDependencyTests-448203194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:23:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b9c431d0-3ef5-431b-be39-8567b459be61 tempest-VolumeDependencyTests-448203194 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:23:11 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-b9c431d0-3ef5-431b-be39-8567b459be61 tempest-VolumeDependencyTests-448203194 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:23:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b9c431d0-3ef5-431b-be39-8567b459be61 tempest-VolumeDependencyTests-448203194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:11 devstack sudo[91577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878 1073741824 Apr 28 19:23:11 devstack sudo[91577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:11 devstack sudo[91575]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-feb03dbf-9ae9-48da-b31b-6bc8d2102543 tempest-VolumesExtendTest-398125600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.656s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:11 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-feb03dbf-9ae9-48da-b31b-6bc8d2102543 tempest-VolumesExtendTest-398125600 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:23:11 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-feb03dbf-9ae9-48da-b31b-6bc8d2102543 tempest-VolumesExtendTest-398125600 None] Deleted volume successfully. Apr 28 19:23:11 devstack sudo[91573]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-04065b13-e2d7-4b5e-90a9-2b7c53d73fa8 tempest-VolumesSnapshotTestJSON-389413737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2b5d447a-818e-4a94-944c-77831dcb91f9.8b15cc3c-a864-40c0-9e94-b8ab24730b93" returned: 0 in 0.822s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-04065b13-e2d7-4b5e-90a9-2b7c53d73fa8 tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2b5d447a-818e-4a94-944c-77831dcb91f9.8b15cc3c-a864-40c0-9e94-b8ab24730b93 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:12 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-feb03dbf-9ae9-48da-b31b-6bc8d2102543 tempest-VolumesExtendTest-398125600 None] Lock "cinder-ddd4434b-bb9c-4b25-b682-1f28f3c214da-delete_volume" released by "delete_volume" :: held 2.444s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:23:12 devstack sudo[91583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2b5d447a-818e-4a94-944c-77831dcb91f9.8b15cc3c-a864-40c0-9e94-b8ab24730b93 Apr 28 19:23:12 devstack sudo[91583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:12 devstack sudo[91577]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b9c431d0-3ef5-431b-be39-8567b459be61 tempest-VolumeDependencyTests-448203194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878 1073741824" returned: 0 in 0.871s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b9c431d0-3ef5-431b-be39-8567b459be61 tempest-VolumeDependencyTests-448203194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:12 devstack sudo[91590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878 Apr 28 19:23:12 devstack sudo[91590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:12 devstack sudo[91583]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-04065b13-e2d7-4b5e-90a9-2b7c53d73fa8 tempest-VolumesSnapshotTestJSON-389413737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2b5d447a-818e-4a94-944c-77831dcb91f9.8b15cc3c-a864-40c0-9e94-b8ab24730b93" returned: 0 in 0.705s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:12 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-04065b13-e2d7-4b5e-90a9-2b7c53d73fa8 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "cinder-quobyte-8b15cc3c-a864-40c0-9e94-b8ab24730b93" released by "_delete_snapshot" :: held 3.230s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:23:12 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-04065b13-e2d7-4b5e-90a9-2b7c53d73fa8 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "cinder-quobyte-2b5d447a-818e-4a94-944c-77831dcb91f9" released by "delete_snapshot" :: held 3.259s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:23:12 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-04065b13-e2d7-4b5e-90a9-2b7c53d73fa8 tempest-VolumesSnapshotTestJSON-389413737 None] Created reservations ['4c1bf17b-7765-4571-9510-153c166b9881', 'd049320a-548f-4d32-82a1-9583bcbdf449', 'c1e6bdde-875e-4475-8cf0-5f2652b8f003', '0fb162b5-cde5-4c53-86ca-e99d7edb2abe'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:23:12 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-04065b13-e2d7-4b5e-90a9-2b7c53d73fa8 tempest-VolumesSnapshotTestJSON-389413737 None] Delete snapshot completed successfully. Apr 28 19:23:12 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-04065b13-e2d7-4b5e-90a9-2b7c53d73fa8 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "cinder-8b15cc3c-a864-40c0-9e94-b8ab24730b93-delete_snapshot" released by "delete_snapshot" :: held 3.448s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:23:13 devstack sudo[91590]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b9c431d0-3ef5-431b-be39-8567b459be61 tempest-VolumeDependencyTests-448203194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878" returned: 0 in 0.654s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b9c431d0-3ef5-431b-be39-8567b459be61 tempest-VolumeDependencyTests-448203194 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:23:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b9c431d0-3ef5-431b-be39-8567b459be61 tempest-VolumeDependencyTests-448203194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.591s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:23:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b9c431d0-3ef5-431b-be39-8567b459be61 tempest-VolumeDependencyTests-448203194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78131d79-44d5-4743-bcfa-e59c389f69dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bae102d6-65a9-4f6e-8196-ab74d4503878', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b9c431d0-3ef5-431b-be39-8567b459be61 tempest-VolumeDependencyTests-448203194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92947e24-392e-410f-b4eb-7f01c396acc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:13 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-b9c431d0-3ef5-431b-be39-8567b459be61 tempest-VolumeDependencyTests-448203194 None] Volume volume-bae102d6-65a9-4f6e-8196-ab74d4503878 (bae102d6-65a9-4f6e-8196-ab74d4503878): created successfully Apr 28 19:23:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b9c431d0-3ef5-431b-be39-8567b459be61 tempest-VolumeDependencyTests-448203194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92947e24-392e-410f-b4eb-7f01c396acc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b9c431d0-3ef5-431b-be39-8567b459be61 tempest-VolumeDependencyTests-448203194 None] Flow 'volume_create_manager' (5a25ed95-f36c-4c1b-aaa0-cf6a8c072080) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:23:13 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-b9c431d0-3ef5-431b-be39-8567b459be61 tempest-VolumeDependencyTests-448203194 None] Created volume successfully. Apr 28 19:23:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-70861405-2e15-4cbe-a273-f694bfe592a0 tempest-VolumeDependencyTests-448203194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:23:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-70861405-2e15-4cbe-a273-f694bfe592a0 tempest-VolumeDependencyTests-448203194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:23:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-70861405-2e15-4cbe-a273-f694bfe592a0 tempest-VolumeDependencyTests-448203194 None] Creating offline snapshot f5cd0264-1975-4a9b-ab41-821e2305422f of volume bae102d6-65a9-4f6e-8196-ab74d4503878 {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 19:23:13 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4960046d-e766-4e62-8f3a-2e88d2065dbe]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:23:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-70861405-2e15-4cbe-a273-f694bfe592a0 tempest-VolumeDependencyTests-448203194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:14 devstack sudo[91593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878 Apr 28 19:23:14 devstack sudo[91593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:14 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-962593d1-a4d6-4c65-97a0-ae49a4d56481 tempest-VolumesSnapshotTestJSON-389413737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:23:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-962593d1-a4d6-4c65-97a0-ae49a4d56481 tempest-VolumesSnapshotTestJSON-389413737 None] Flow 'volume_create_manager' (90b25405-6406-4405-b00e-c6ee2811e91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:23:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-962593d1-a4d6-4c65-97a0-ae49a4d56481 tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (161698cc-3d30-46e6-879c-6dbaa2a9c34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-962593d1-a4d6-4c65-97a0-ae49a4d56481 tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (161698cc-3d30-46e6-879c-6dbaa2a9c34a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1190852291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70889c45-9ce2-4bf9-b757-afc1275279d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcd7eac94c09403f92b066b388f6d053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:23:14Z,use_quota=True,user_id='57349484d0c543c39251044039afccea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-962593d1-a4d6-4c65-97a0-ae49a4d56481 tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6868c972-a489-4de0-86ac-27380468f3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-962593d1-a4d6-4c65-97a0-ae49a4d56481 tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6868c972-a489-4de0-86ac-27380468f3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-962593d1-a4d6-4c65-97a0-ae49a4d56481 tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1722174b-815d-46e5-8e56-3e9bf8140a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-962593d1-a4d6-4c65-97a0-ae49a4d56481 tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1722174b-815d-46e5-8e56-3e9bf8140a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70889c45-9ce2-4bf9-b757-afc1275279d0', 'volume_name': 'volume-70889c45-9ce2-4bf9-b757-afc1275279d0', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-962593d1-a4d6-4c65-97a0-ae49a4d56481 tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33f3685c-c2b5-46b6-a45a-f2982581e3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-962593d1-a4d6-4c65-97a0-ae49a4d56481 tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33f3685c-c2b5-46b6-a45a-f2982581e3a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-962593d1-a4d6-4c65-97a0-ae49a4d56481 tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f269cb8e-f3c6-4b48-b38a-23739aae181e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:14 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-962593d1-a4d6-4c65-97a0-ae49a4d56481 tempest-VolumesSnapshotTestJSON-389413737 None] Volume 70889c45-9ce2-4bf9-b757-afc1275279d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70889c45-9ce2-4bf9-b757-afc1275279d0', 'volume_size': 1} Apr 28 19:23:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-962593d1-a4d6-4c65-97a0-ae49a4d56481 tempest-VolumesSnapshotTestJSON-389413737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:23:14 devstack sudo[91593]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-70861405-2e15-4cbe-a273-f694bfe592a0 tempest-VolumeDependencyTests-448203194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878" returned: 0 in 0.775s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-70861405-2e15-4cbe-a273-f694bfe592a0 tempest-VolumeDependencyTests-448203194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878.f5cd0264-1975-4a9b-ab41-821e2305422f 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:14 devstack sudo[91598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878.f5cd0264-1975-4a9b-ab41-821e2305422f 1G Apr 28 19:23:14 devstack sudo[91598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:15 devstack sudo[91598]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-70861405-2e15-4cbe-a273-f694bfe592a0 tempest-VolumeDependencyTests-448203194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878.f5cd0264-1975-4a9b-ab41-821e2305422f 1G" returned: 0 in 0.808s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-70861405-2e15-4cbe-a273-f694bfe592a0 tempest-VolumeDependencyTests-448203194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bae102d6-65a9-4f6e-8196-ab74d4503878 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878.f5cd0264-1975-4a9b-ab41-821e2305422f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:15 devstack sudo[91604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bae102d6-65a9-4f6e-8196-ab74d4503878 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878.f5cd0264-1975-4a9b-ab41-821e2305422f Apr 28 19:23:15 devstack sudo[91604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:16 devstack sudo[91604]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-70861405-2e15-4cbe-a273-f694bfe592a0 tempest-VolumeDependencyTests-448203194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bae102d6-65a9-4f6e-8196-ab74d4503878 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878.f5cd0264-1975-4a9b-ab41-821e2305422f" returned: 0 in 0.711s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:16 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-70861405-2e15-4cbe-a273-f694bfe592a0 tempest-VolumeDependencyTests-448203194 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878.f5cd0264-1975-4a9b-ab41-821e2305422f is being set with open permissions: ugo+rw Apr 28 19:23:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-70861405-2e15-4cbe-a273-f694bfe592a0 tempest-VolumeDependencyTests-448203194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878.f5cd0264-1975-4a9b-ab41-821e2305422f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:16 devstack sudo[91609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878.f5cd0264-1975-4a9b-ab41-821e2305422f Apr 28 19:23:16 devstack sudo[91609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:16 devstack sudo[91609]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-70861405-2e15-4cbe-a273-f694bfe592a0 tempest-VolumeDependencyTests-448203194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878.f5cd0264-1975-4a9b-ab41-821e2305422f" returned: 0 in 0.623s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:16 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-49e0423f-83fe-429f-ac18-f73142fd0ec9 tempest-VolumesNegativeTest-1079561226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:23:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-49e0423f-83fe-429f-ac18-f73142fd0ec9 tempest-VolumesNegativeTest-1079561226 None] Flow 'volume_create_manager' (9685bc0d-9020-42c3-ba39-70ef52c2dd71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:23:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-49e0423f-83fe-429f-ac18-f73142fd0ec9 tempest-VolumesNegativeTest-1079561226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53f33bdf-c2a8-41f9-860c-fd0059366112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-70861405-2e15-4cbe-a273-f694bfe592a0 tempest-VolumeDependencyTests-448203194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-49e0423f-83fe-429f-ac18-f73142fd0ec9 tempest-VolumesNegativeTest-1079561226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53f33bdf-c2a8-41f9-860c-fd0059366112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1523415397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f18b232-b8ea-4c90-ab50-073397a03094,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cee288a52d544288fbf97692b61b9fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:23:17Z,use_quota=True,user_id='100be64a8f8d43f3a460574e58273a95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-49e0423f-83fe-429f-ac18-f73142fd0ec9 tempest-VolumesNegativeTest-1079561226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c98ea344-cf91-44af-856b-8dce1385bbbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:17 devstack sudo[91612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878.info Apr 28 19:23:17 devstack sudo[91612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-49e0423f-83fe-429f-ac18-f73142fd0ec9 tempest-VolumesNegativeTest-1079561226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c98ea344-cf91-44af-856b-8dce1385bbbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-49e0423f-83fe-429f-ac18-f73142fd0ec9 tempest-VolumesNegativeTest-1079561226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d1df7b2-bd5c-468f-a932-cd70816bf873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-49e0423f-83fe-429f-ac18-f73142fd0ec9 tempest-VolumesNegativeTest-1079561226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d1df7b2-bd5c-468f-a932-cd70816bf873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f18b232-b8ea-4c90-ab50-073397a03094', 'volume_name': 'volume-4f18b232-b8ea-4c90-ab50-073397a03094', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-49e0423f-83fe-429f-ac18-f73142fd0ec9 tempest-VolumesNegativeTest-1079561226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (945432b6-9c34-46ec-89b8-b57d88b7cd3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-49e0423f-83fe-429f-ac18-f73142fd0ec9 tempest-VolumesNegativeTest-1079561226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (945432b6-9c34-46ec-89b8-b57d88b7cd3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-49e0423f-83fe-429f-ac18-f73142fd0ec9 tempest-VolumesNegativeTest-1079561226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce6010f5-8d0f-4daa-bfd5-e5fc21a11934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:17 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-49e0423f-83fe-429f-ac18-f73142fd0ec9 tempest-VolumesNegativeTest-1079561226 None] Volume 4f18b232-b8ea-4c90-ab50-073397a03094: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f18b232-b8ea-4c90-ab50-073397a03094', 'volume_size': 1} Apr 28 19:23:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-49e0423f-83fe-429f-ac18-f73142fd0ec9 tempest-VolumesNegativeTest-1079561226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:23:17 devstack sudo[91612]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-70861405-2e15-4cbe-a273-f694bfe592a0 tempest-VolumeDependencyTests-448203194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878.info" returned: 0 in 0.616s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:17 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-70861405-2e15-4cbe-a273-f694bfe592a0 tempest-VolumeDependencyTests-448203194 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878.info is being set with open permissions: ugo+rw Apr 28 19:23:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-70861405-2e15-4cbe-a273-f694bfe592a0 tempest-VolumeDependencyTests-448203194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:17 devstack sudo[91615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878.info Apr 28 19:23:17 devstack sudo[91615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:18 devstack sudo[91615]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-70861405-2e15-4cbe-a273-f694bfe592a0 tempest-VolumeDependencyTests-448203194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878.info" returned: 0 in 0.608s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-70861405-2e15-4cbe-a273-f694bfe592a0 tempest-VolumeDependencyTests-448203194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.292s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:23:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-962593d1-a4d6-4c65-97a0-ae49a4d56481 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.912s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:23:18 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-962593d1-a4d6-4c65-97a0-ae49a4d56481 tempest-VolumesSnapshotTestJSON-389413737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1190852291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70889c45-9ce2-4bf9-b757-afc1275279d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcd7eac94c09403f92b066b388f6d053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:23:14Z,use_quota=True,user_id='57349484d0c543c39251044039afccea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:23:18 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-962593d1-a4d6-4c65-97a0-ae49a4d56481 tempest-VolumesSnapshotTestJSON-389413737 None] Creating volume 70889c45-9ce2-4bf9-b757-afc1275279d0 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:23:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-962593d1-a4d6-4c65-97a0-ae49a4d56481 tempest-VolumesSnapshotTestJSON-389413737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:23:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-962593d1-a4d6-4c65-97a0-ae49a4d56481 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:23:18 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-962593d1-a4d6-4c65-97a0-ae49a4d56481 tempest-VolumesSnapshotTestJSON-389413737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:23:18 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-962593d1-a4d6-4c65-97a0-ae49a4d56481 tempest-VolumesSnapshotTestJSON-389413737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:23:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-962593d1-a4d6-4c65-97a0-ae49a4d56481 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:23:18 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-962593d1-a4d6-4c65-97a0-ae49a4d56481 tempest-VolumesSnapshotTestJSON-389413737 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:23:18 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-962593d1-a4d6-4c65-97a0-ae49a4d56481 tempest-VolumesSnapshotTestJSON-389413737 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:23:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-962593d1-a4d6-4c65-97a0-ae49a4d56481 tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:18 devstack sudo[91618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0 1073741824 Apr 28 19:23:18 devstack sudo[91618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:18 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-70861405-2e15-4cbe-a273-f694bfe592a0 tempest-VolumeDependencyTests-448203194 None] Create snapshot completed successfully Apr 28 19:23:19 devstack sudo[91618]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-962593d1-a4d6-4c65-97a0-ae49a4d56481 tempest-VolumesSnapshotTestJSON-389413737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0 1073741824" returned: 0 in 0.783s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-962593d1-a4d6-4c65-97a0-ae49a4d56481 tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:19 devstack sudo[91623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0 Apr 28 19:23:19 devstack sudo[91623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:19 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:23:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] Flow 'volume_create_manager' (9eb57eb3-6841-4ff2-a161-cc9b77a475dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:23:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d09624d-c906-45bd-833e-02ddc2295a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d09624d-c906-45bd-833e-02ddc2295a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:23:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-435234733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=521ded01-d778-486f-88ec-41c2ed498db9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff619ae26a3941c3bb83a36d3a29d9da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f5cd0264-1975-4a9b-ab41-821e2305422f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:23:20Z,use_quota=True,user_id='7c106efa0d134538838c2a28c50746c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (141f2cfa-2cd4-4e2a-b185-85963191f735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (141f2cfa-2cd4-4e2a-b185-85963191f735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f95018ab-67c7-4b87-a329-8e26602907d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:19 devstack sudo[91623]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f95018ab-67c7-4b87-a329-8e26602907d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '521ded01-d778-486f-88ec-41c2ed498db9', 'volume_name': 'volume-521ded01-d778-486f-88ec-41c2ed498db9', 'volume_size': 1, 'snapshot_id': 'f5cd0264-1975-4a9b-ab41-821e2305422f'}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0648fcf8-033f-4bf7-ac4b-5e2f0d680c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0648fcf8-033f-4bf7-ac4b-5e2f0d680c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fec3aad-4bb3-407a-a845-1c234d4139ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:19 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] Volume 521ded01-d778-486f-88ec-41c2ed498db9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-521ded01-d778-486f-88ec-41c2ed498db9', 'volume_size': 1, 'snapshot_id': 'f5cd0264-1975-4a9b-ab41-821e2305422f'} Apr 28 19:23:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-962593d1-a4d6-4c65-97a0-ae49a4d56481 tempest-VolumesSnapshotTestJSON-389413737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0" returned: 0 in 0.635s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-962593d1-a4d6-4c65-97a0-ae49a4d56481 tempest-VolumesSnapshotTestJSON-389413737 None] <== create_volume: return (1456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:23:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-962593d1-a4d6-4c65-97a0-ae49a4d56481 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.460s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:23:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-49e0423f-83fe-429f-ac18-f73142fd0ec9 tempest-VolumesNegativeTest-1079561226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.644s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:23:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-49e0423f-83fe-429f-ac18-f73142fd0ec9 tempest-VolumesNegativeTest-1079561226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1523415397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f18b232-b8ea-4c90-ab50-073397a03094,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cee288a52d544288fbf97692b61b9fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:23:17Z,use_quota=True,user_id='100be64a8f8d43f3a460574e58273a95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:23:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-49e0423f-83fe-429f-ac18-f73142fd0ec9 tempest-VolumesNegativeTest-1079561226 None] Creating volume 4f18b232-b8ea-4c90-ab50-073397a03094 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:23:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-49e0423f-83fe-429f-ac18-f73142fd0ec9 tempest-VolumesNegativeTest-1079561226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:23:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-49e0423f-83fe-429f-ac18-f73142fd0ec9 tempest-VolumesNegativeTest-1079561226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:23:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-49e0423f-83fe-429f-ac18-f73142fd0ec9 tempest-VolumesNegativeTest-1079561226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:23:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-49e0423f-83fe-429f-ac18-f73142fd0ec9 tempest-VolumesNegativeTest-1079561226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:23:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-49e0423f-83fe-429f-ac18-f73142fd0ec9 tempest-VolumesNegativeTest-1079561226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:23:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-49e0423f-83fe-429f-ac18-f73142fd0ec9 tempest-VolumesNegativeTest-1079561226 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:23:19 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-49e0423f-83fe-429f-ac18-f73142fd0ec9 tempest-VolumesNegativeTest-1079561226 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:23:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-49e0423f-83fe-429f-ac18-f73142fd0ec9 tempest-VolumesNegativeTest-1079561226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4f18b232-b8ea-4c90-ab50-073397a03094 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:23:19 devstack sudo[91626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4f18b232-b8ea-4c90-ab50-073397a03094 1073741824 Apr 28 19:23:19 devstack sudo[91626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-962593d1-a4d6-4c65-97a0-ae49a4d56481 tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f269cb8e-f3c6-4b48-b38a-23739aae181e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70889c45-9ce2-4bf9-b757-afc1275279d0', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-962593d1-a4d6-4c65-97a0-ae49a4d56481 tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3983ce37-707e-4b55-bcda-1922b104ce4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:19 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-962593d1-a4d6-4c65-97a0-ae49a4d56481 tempest-VolumesSnapshotTestJSON-389413737 None] Volume volume-70889c45-9ce2-4bf9-b757-afc1275279d0 (70889c45-9ce2-4bf9-b757-afc1275279d0): created successfully Apr 28 19:23:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-962593d1-a4d6-4c65-97a0-ae49a4d56481 tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3983ce37-707e-4b55-bcda-1922b104ce4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-962593d1-a4d6-4c65-97a0-ae49a4d56481 tempest-VolumesSnapshotTestJSON-389413737 None] Flow 'volume_create_manager' (90b25405-6406-4405-b00e-c6ee2811e91a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:23:19 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-962593d1-a4d6-4c65-97a0-ae49a4d56481 tempest-VolumesSnapshotTestJSON-389413737 None] Created volume successfully. Apr 28 19:23:20 devstack sudo[91626]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-49e0423f-83fe-429f-ac18-f73142fd0ec9 tempest-VolumesNegativeTest-1079561226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4f18b232-b8ea-4c90-ab50-073397a03094 1073741824" returned: 0 in 0.820s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-49e0423f-83fe-429f-ac18-f73142fd0ec9 tempest-VolumesNegativeTest-1079561226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4f18b232-b8ea-4c90-ab50-073397a03094 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:20 devstack sudo[91631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4f18b232-b8ea-4c90-ab50-073397a03094 Apr 28 19:23:20 devstack sudo[91631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5d78749b-6a73-4840-970e-24040040c84f tempest-VolumesSnapshotTestJSON-389413737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:23:21 devstack sudo[91631]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-49e0423f-83fe-429f-ac18-f73142fd0ec9 tempest-VolumesNegativeTest-1079561226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4f18b232-b8ea-4c90-ab50-073397a03094" returned: 0 in 0.628s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:21 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-49e0423f-83fe-429f-ac18-f73142fd0ec9 tempest-VolumesNegativeTest-1079561226 None] <== create_volume: return (1496ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:23:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-49e0423f-83fe-429f-ac18-f73142fd0ec9 tempest-VolumesNegativeTest-1079561226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.498s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:23:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.476s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:23:21 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] Acquiring lock "cinder-quobyte-f5cd0264-1975-4a9b-ab41-821e2305422f-521ded01-d778-486f-88ec-41c2ed498db9" by "_create_volume_from_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:23:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-49e0423f-83fe-429f-ac18-f73142fd0ec9 tempest-VolumesNegativeTest-1079561226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce6010f5-8d0f-4daa-bfd5-e5fc21a11934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f18b232-b8ea-4c90-ab50-073397a03094', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-49e0423f-83fe-429f-ac18-f73142fd0ec9 tempest-VolumesNegativeTest-1079561226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (989411fa-6e47-4231-820b-bfb27bb9f1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:21 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] Lock "cinder-quobyte-f5cd0264-1975-4a9b-ab41-821e2305422f-521ded01-d778-486f-88ec-41c2ed498db9" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:23:21 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] Creating volume 521ded01-d778-486f-88ec-41c2ed498db9 from snapshot f5cd0264-1975-4a9b-ab41-821e2305422f {{(pid=83863) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 28 19:23:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:23:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:23:21 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:23:21 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:23:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:23:21 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:23:21 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] Acquiring lock "cinder-quobyte-521ded01-d778-486f-88ec-41c2ed498db9" by "_copy_volume_from_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:23:21 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-49e0423f-83fe-429f-ac18-f73142fd0ec9 tempest-VolumesNegativeTest-1079561226 None] Volume volume-4f18b232-b8ea-4c90-ab50-073397a03094 (4f18b232-b8ea-4c90-ab50-073397a03094): created successfully Apr 28 19:23:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-49e0423f-83fe-429f-ac18-f73142fd0ec9 tempest-VolumesNegativeTest-1079561226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (989411fa-6e47-4231-820b-bfb27bb9f1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-49e0423f-83fe-429f-ac18-f73142fd0ec9 tempest-VolumesNegativeTest-1079561226 None] Flow 'volume_create_manager' (9685bc0d-9020-42c3-ba39-70ef52c2dd71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:23:21 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] Lock "cinder-quobyte-521ded01-d778-486f-88ec-41c2ed498db9" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:23:21 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] snapshot: f5cd0264-1975-4a9b-ab41-821e2305422f, volume: 521ded01-d778-486f-88ec-41c2ed498db9, {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 19:23:21 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-49e0423f-83fe-429f-ac18-f73142fd0ec9 tempest-VolumesNegativeTest-1079561226 None] Created volume successfully. Apr 28 19:23:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:23:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:23:21 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:23:21 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:23:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:23:21 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0492564-e2fa-4275-9061-e9b30b66dbc2]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:23:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878.f5cd0264-1975-4a9b-ab41-821e2305422f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:21 devstack sudo[91635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878.f5cd0264-1975-4a9b-ab41-821e2305422f Apr 28 19:23:21 devstack sudo[91635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:22 devstack sudo[91635]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878.f5cd0264-1975-4a9b-ab41-821e2305422f" returned: 0 in 0.716s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:22 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bae102d6-65a9-4f6e-8196-ab74d4503878(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:23:22 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878 {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 19:23:22 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] Creating direct copy from snapshot {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 19:23:22 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[44feab76-af54-44a1-b226-47f1f3db4062]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:23:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:22 devstack sudo[91640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878 Apr 28 19:23:22 devstack sudo[91640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:22 devstack sudo[91640]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878" returned: 0 in 0.732s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:22 devstack cinder-volume[83863]: DEBUG cinder.utils [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] Path /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-521ded01-d778-486f-88ec-41c2ed498db9 not found in is_blk_device check {{(pid=83863) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 19:23:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-521ded01-d778-486f-88ec-41c2ed498db9 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:22 devstack sudo[91645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-521ded01-d778-486f-88ec-41c2ed498db9 Apr 28 19:23:22 devstack sudo[91645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:27 devstack sudo[91645]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-521ded01-d778-486f-88ec-41c2ed498db9" returned: 0 in 4.911s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:27 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18c83c4-2a74-47d8-afe2-82e065672030]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:23:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:27 devstack sudo[91662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878 Apr 28 19:23:27 devstack sudo[91662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:28 devstack sudo[91662]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878" returned: 0 in 0.950s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:28 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] Image conversion details: src /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878, size 1024.00 MB, duration 4.91 sec, destination /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-521ded01-d778-486f-88ec-41c2ed498db9 {{(pid=83863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 19:23:28 devstack cinder-volume[83863]: INFO cinder.image.image_utils [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] Converted 1024.00 MB image at 208.46 MB/s Apr 28 19:23:28 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-521ded01-d778-486f-88ec-41c2ed498db9 is being set with open permissions: ugo+rw Apr 28 19:23:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-521ded01-d778-486f-88ec-41c2ed498db9 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:28 devstack sudo[91667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-521ded01-d778-486f-88ec-41c2ed498db9 Apr 28 19:23:28 devstack sudo[91667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:29 devstack sudo[91667]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-521ded01-d778-486f-88ec-41c2ed498db9" returned: 0 in 0.619s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:29 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] Lock "cinder-quobyte-521ded01-d778-486f-88ec-41c2ed498db9" released by "_copy_volume_from_snapshot" :: held 8.022s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:23:29 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] Lock "cinder-quobyte-f5cd0264-1975-4a9b-ab41-821e2305422f-521ded01-d778-486f-88ec-41c2ed498db9" released by "_create_volume_from_snapshot" :: held 8.066s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:23:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.096s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:23:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5d78749b-6a73-4840-970e-24040040c84f tempest-VolumesSnapshotTestJSON-389413737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.529s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:23:29 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-5d78749b-6a73-4840-970e-24040040c84f tempest-VolumesSnapshotTestJSON-389413737 None] Creating offline snapshot 0ea91114-9904-45d1-a7f9-44323efa3cce of volume 70889c45-9ce2-4bf9-b757-afc1275279d0 {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 19:23:29 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fec3aad-4bb3-407a-a845-1c234d4139ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-521ded01-d778-486f-88ec-41c2ed498db9', 'volume_size': 1, 'snapshot_id': 'f5cd0264-1975-4a9b-ab41-821e2305422f'}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:29 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b5e47be-acfc-4969-82d1-bc42bb097faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:29 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f84bb6-3854-4852-b4b5-ef1aeb59a1a8]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:23:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5d78749b-6a73-4840-970e-24040040c84f tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:29 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] Volume volume-521ded01-d778-486f-88ec-41c2ed498db9 (521ded01-d778-486f-88ec-41c2ed498db9): created successfully Apr 28 19:23:29 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b5e47be-acfc-4969-82d1-bc42bb097faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:29 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] Flow 'volume_create_manager' (9eb57eb3-6841-4ff2-a161-cc9b77a475dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:23:29 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-91342232-eb2b-4bf7-84f2-deee0cf7e749 tempest-VolumeDependencyTests-448203194 None] Created volume successfully. Apr 28 19:23:29 devstack sudo[91670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0 Apr 28 19:23:29 devstack sudo[91670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:30 devstack sudo[91670]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5d78749b-6a73-4840-970e-24040040c84f tempest-VolumesSnapshotTestJSON-389413737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0" returned: 0 in 0.798s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5d78749b-6a73-4840-970e-24040040c84f tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0.0ea91114-9904-45d1-a7f9-44323efa3cce 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:30 devstack sudo[91675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0.0ea91114-9904-45d1-a7f9-44323efa3cce 1G Apr 28 19:23:30 devstack sudo[91675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:30 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c498a7e5-4d3e-428d-aa37-bb8636b88556 tempest-VolumeDependencyTests-448203194 None] Acquiring lock "cinder-f5cd0264-1975-4a9b-ab41-821e2305422f-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:23:30 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c498a7e5-4d3e-428d-aa37-bb8636b88556 tempest-VolumeDependencyTests-448203194 None] Lock "cinder-f5cd0264-1975-4a9b-ab41-821e2305422f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:23:30 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c498a7e5-4d3e-428d-aa37-bb8636b88556 tempest-VolumeDependencyTests-448203194 None] Acquiring lock "cinder-quobyte-bae102d6-65a9-4f6e-8196-ab74d4503878" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:23:30 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c498a7e5-4d3e-428d-aa37-bb8636b88556 tempest-VolumeDependencyTests-448203194 None] Lock "cinder-quobyte-bae102d6-65a9-4f6e-8196-ab74d4503878" acquired by "delete_snapshot" :: waited 0.024s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:23:30 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c498a7e5-4d3e-428d-aa37-bb8636b88556 tempest-VolumeDependencyTests-448203194 None] Acquiring lock "cinder-quobyte-f5cd0264-1975-4a9b-ab41-821e2305422f" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:23:30 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c498a7e5-4d3e-428d-aa37-bb8636b88556 tempest-VolumeDependencyTests-448203194 None] Lock "cinder-quobyte-f5cd0264-1975-4a9b-ab41-821e2305422f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:23:30 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-c498a7e5-4d3e-428d-aa37-bb8636b88556 tempest-VolumeDependencyTests-448203194 None] Deleting offline snapshot f5cd0264-1975-4a9b-ab41-821e2305422f of volume bae102d6-65a9-4f6e-8196-ab74d4503878 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 19:23:30 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-c498a7e5-4d3e-428d-aa37-bb8636b88556 tempest-VolumeDependencyTests-448203194 None] snapshot_file for this snap is: volume-bae102d6-65a9-4f6e-8196-ab74d4503878.f5cd0264-1975-4a9b-ab41-821e2305422f {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 19:23:30 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d83538-32dc-44a4-a20e-70a9bd4dd40c]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:23:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c498a7e5-4d3e-428d-aa37-bb8636b88556 tempest-VolumeDependencyTests-448203194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878.f5cd0264-1975-4a9b-ab41-821e2305422f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:30 devstack sudo[91684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878.f5cd0264-1975-4a9b-ab41-821e2305422f Apr 28 19:23:30 devstack sudo[91684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:31 devstack sudo[91675]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5d78749b-6a73-4840-970e-24040040c84f tempest-VolumesSnapshotTestJSON-389413737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0.0ea91114-9904-45d1-a7f9-44323efa3cce 1G" returned: 0 in 0.980s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5d78749b-6a73-4840-970e-24040040c84f tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70889c45-9ce2-4bf9-b757-afc1275279d0 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0.0ea91114-9904-45d1-a7f9-44323efa3cce {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:31 devstack sudo[91702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70889c45-9ce2-4bf9-b757-afc1275279d0 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0.0ea91114-9904-45d1-a7f9-44323efa3cce Apr 28 19:23:31 devstack sudo[91702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:31 devstack sudo[91684]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c498a7e5-4d3e-428d-aa37-bb8636b88556 tempest-VolumeDependencyTests-448203194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878.f5cd0264-1975-4a9b-ab41-821e2305422f" returned: 0 in 0.895s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:31 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-c498a7e5-4d3e-428d-aa37-bb8636b88556 tempest-VolumeDependencyTests-448203194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bae102d6-65a9-4f6e-8196-ab74d4503878(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:23:31 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ee2eef-63f5-47be-a51e-29479c70c5ed]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:23:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c498a7e5-4d3e-428d-aa37-bb8636b88556 tempest-VolumeDependencyTests-448203194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:31 devstack sudo[91707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878 Apr 28 19:23:31 devstack sudo[91707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:31 devstack sudo[91702]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5d78749b-6a73-4840-970e-24040040c84f tempest-VolumesSnapshotTestJSON-389413737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70889c45-9ce2-4bf9-b757-afc1275279d0 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0.0ea91114-9904-45d1-a7f9-44323efa3cce" returned: 0 in 0.668s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:31 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-5d78749b-6a73-4840-970e-24040040c84f tempest-VolumesSnapshotTestJSON-389413737 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0.0ea91114-9904-45d1-a7f9-44323efa3cce is being set with open permissions: ugo+rw Apr 28 19:23:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5d78749b-6a73-4840-970e-24040040c84f tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0.0ea91114-9904-45d1-a7f9-44323efa3cce {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:31 devstack sudo[91712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0.0ea91114-9904-45d1-a7f9-44323efa3cce Apr 28 19:23:31 devstack sudo[91712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:32 devstack sudo[91707]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c498a7e5-4d3e-428d-aa37-bb8636b88556 tempest-VolumeDependencyTests-448203194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878" returned: 0 in 0.757s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c498a7e5-4d3e-428d-aa37-bb8636b88556 tempest-VolumeDependencyTests-448203194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878.f5cd0264-1975-4a9b-ab41-821e2305422f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:32 devstack sudo[91718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878.f5cd0264-1975-4a9b-ab41-821e2305422f Apr 28 19:23:32 devstack sudo[91718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:32 devstack sudo[91712]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5d78749b-6a73-4840-970e-24040040c84f tempest-VolumesSnapshotTestJSON-389413737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0.0ea91114-9904-45d1-a7f9-44323efa3cce" returned: 0 in 0.636s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5d78749b-6a73-4840-970e-24040040c84f tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:32 devstack sudo[91720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0.info Apr 28 19:23:32 devstack sudo[91720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:33 devstack sudo[91718]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c498a7e5-4d3e-428d-aa37-bb8636b88556 tempest-VolumeDependencyTests-448203194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878.f5cd0264-1975-4a9b-ab41-821e2305422f" returned: 0 in 0.721s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c498a7e5-4d3e-428d-aa37-bb8636b88556 tempest-VolumeDependencyTests-448203194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878.f5cd0264-1975-4a9b-ab41-821e2305422f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:33 devstack sudo[91720]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5d78749b-6a73-4840-970e-24040040c84f tempest-VolumesSnapshotTestJSON-389413737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0.info" returned: 0 in 0.627s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:33 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-5d78749b-6a73-4840-970e-24040040c84f tempest-VolumesSnapshotTestJSON-389413737 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0.info is being set with open permissions: ugo+rw Apr 28 19:23:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5d78749b-6a73-4840-970e-24040040c84f tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:33 devstack sudo[91727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878.f5cd0264-1975-4a9b-ab41-821e2305422f Apr 28 19:23:33 devstack sudo[91727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:33 devstack sudo[91729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0.info Apr 28 19:23:33 devstack sudo[91729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:33 devstack sudo[91727]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c498a7e5-4d3e-428d-aa37-bb8636b88556 tempest-VolumeDependencyTests-448203194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878.f5cd0264-1975-4a9b-ab41-821e2305422f" returned: 0 in 0.624s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:33 devstack sudo[91729]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5d78749b-6a73-4840-970e-24040040c84f tempest-VolumesSnapshotTestJSON-389413737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0.info" returned: 0 in 0.642s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5d78749b-6a73-4840-970e-24040040c84f tempest-VolumesSnapshotTestJSON-389413737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.500s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:23:33 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c498a7e5-4d3e-428d-aa37-bb8636b88556 tempest-VolumeDependencyTests-448203194 None] Lock "cinder-quobyte-f5cd0264-1975-4a9b-ab41-821e2305422f" released by "_delete_snapshot" :: held 3.158s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:23:33 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c498a7e5-4d3e-428d-aa37-bb8636b88556 tempest-VolumeDependencyTests-448203194 None] Lock "cinder-quobyte-bae102d6-65a9-4f6e-8196-ab74d4503878" released by "delete_snapshot" :: held 3.188s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:23:33 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-5d78749b-6a73-4840-970e-24040040c84f tempest-VolumesSnapshotTestJSON-389413737 None] Create snapshot completed successfully Apr 28 19:23:33 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-c498a7e5-4d3e-428d-aa37-bb8636b88556 tempest-VolumeDependencyTests-448203194 None] Created reservations ['1187d735-53c6-491f-82c6-988c676e9088', '59c9b7bf-0235-4446-aa7b-7a9d97e22b3b', '666115aa-b89c-408c-8973-4da689eaecda', '6f9c9cec-fba2-49dd-90ea-9163ac0fd199'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:23:33 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-c498a7e5-4d3e-428d-aa37-bb8636b88556 tempest-VolumeDependencyTests-448203194 None] Delete snapshot completed successfully. Apr 28 19:23:33 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c498a7e5-4d3e-428d-aa37-bb8636b88556 tempest-VolumeDependencyTests-448203194 None] Lock "cinder-f5cd0264-1975-4a9b-ab41-821e2305422f-delete_snapshot" released by "delete_snapshot" :: held 3.341s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:23:34 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-245c7bab-d3a3-417c-8527-9e407a2eb842 tempest-VolumeDependencyTests-448203194 None] Acquiring lock "cinder-bae102d6-65a9-4f6e-8196-ab74d4503878-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:23:34 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-245c7bab-d3a3-417c-8527-9e407a2eb842 tempest-VolumeDependencyTests-448203194 None] Lock "cinder-bae102d6-65a9-4f6e-8196-ab74d4503878-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:23:34 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-245c7bab-d3a3-417c-8527-9e407a2eb842 tempest-VolumeDependencyTests-448203194 None] Acquiring lock "cinder-quobyte-bae102d6-65a9-4f6e-8196-ab74d4503878" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:23:34 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-245c7bab-d3a3-417c-8527-9e407a2eb842 tempest-VolumeDependencyTests-448203194 None] Lock "cinder-quobyte-bae102d6-65a9-4f6e-8196-ab74d4503878" acquired by "delete_volume" :: waited 0.015s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:23:34 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d642ee-713c-456c-9b49-aed3f36f07ee]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:23:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-245c7bab-d3a3-417c-8527-9e407a2eb842 tempest-VolumeDependencyTests-448203194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:35 devstack sudo[91738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878 Apr 28 19:23:35 devstack sudo[91738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:35 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:23:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] Flow 'volume_create_manager' (5450ca2e-6e62-46a1-8d85-fe812bd5fb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:23:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6215412-51a4-4a36-b1be-65636998e6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6215412-51a4-4a36-b1be-65636998e6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1022640382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84b90bb8-64a1-4773-be63-0c5598db6607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcd7eac94c09403f92b066b388f6d053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:23:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=0ea91114-9904-45d1-a7f9-44323efa3cce,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:23:35Z,use_quota=True,user_id='57349484d0c543c39251044039afccea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6e87736-93fb-4ff7-a5f4-4d17b4176c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6e87736-93fb-4ff7-a5f4-4d17b4176c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f628d41-3a05-43a6-8a86-26475e17c6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f628d41-3a05-43a6-8a86-26475e17c6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '84b90bb8-64a1-4773-be63-0c5598db6607', 'volume_name': 'volume-84b90bb8-64a1-4773-be63-0c5598db6607', 'volume_size': 2, 'snapshot_id': '0ea91114-9904-45d1-a7f9-44323efa3cce'}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91334329-6332-4dac-a861-42d56efc16cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91334329-6332-4dac-a861-42d56efc16cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7965610e-93c1-45e8-884a-79e4f386dab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:35 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] Volume 84b90bb8-64a1-4773-be63-0c5598db6607: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-84b90bb8-64a1-4773-be63-0c5598db6607', 'volume_size': 2, 'snapshot_id': '0ea91114-9904-45d1-a7f9-44323efa3cce'} Apr 28 19:23:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:23:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:23:35 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] Acquiring lock "cinder-quobyte-0ea91114-9904-45d1-a7f9-44323efa3cce-84b90bb8-64a1-4773-be63-0c5598db6607" by "_create_volume_from_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:23:35 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "cinder-quobyte-0ea91114-9904-45d1-a7f9-44323efa3cce-84b90bb8-64a1-4773-be63-0c5598db6607" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:23:35 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] Creating volume 84b90bb8-64a1-4773-be63-0c5598db6607 from snapshot 0ea91114-9904-45d1-a7f9-44323efa3cce {{(pid=83863) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 28 19:23:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:23:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:23:35 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:23:35 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:23:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:23:35 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:23:35 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] Acquiring lock "cinder-quobyte-84b90bb8-64a1-4773-be63-0c5598db6607" by "_copy_volume_from_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:23:35 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "cinder-quobyte-84b90bb8-64a1-4773-be63-0c5598db6607" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:23:35 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] snapshot: 0ea91114-9904-45d1-a7f9-44323efa3cce, volume: 84b90bb8-64a1-4773-be63-0c5598db6607, {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 19:23:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:23:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:23:35 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:23:35 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:23:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:23:35 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[db900665-b7e4-45d4-abc6-ae7517f86c5f]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:23:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0.0ea91114-9904-45d1-a7f9-44323efa3cce {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:35 devstack sudo[91740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0.0ea91114-9904-45d1-a7f9-44323efa3cce Apr 28 19:23:35 devstack sudo[91740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:35 devstack sudo[91738]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-245c7bab-d3a3-417c-8527-9e407a2eb842 tempest-VolumeDependencyTests-448203194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878" returned: 0 in 0.749s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-245c7bab-d3a3-417c-8527-9e407a2eb842 tempest-VolumeDependencyTests-448203194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:35 devstack sudo[91745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878 Apr 28 19:23:35 devstack sudo[91745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:36 devstack sudo[91740]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0.0ea91114-9904-45d1-a7f9-44323efa3cce" returned: 0 in 1.041s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:36 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70889c45-9ce2-4bf9-b757-afc1275279d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:23:36 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0 {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 19:23:36 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] Creating direct copy from snapshot {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 19:23:36 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed52e1a-2e00-45d3-b801-8bb70cc672a0]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:23:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:36 devstack sudo[91799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0 Apr 28 19:23:36 devstack sudo[91799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:36 devstack sudo[91745]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-245c7bab-d3a3-417c-8527-9e407a2eb842 tempest-VolumeDependencyTests-448203194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bae102d6-65a9-4f6e-8196-ab74d4503878" returned: 0 in 1.270s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:37 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-245c7bab-d3a3-417c-8527-9e407a2eb842 tempest-VolumeDependencyTests-448203194 None] Lock "cinder-quobyte-bae102d6-65a9-4f6e-8196-ab74d4503878" released by "delete_volume" :: held 2.124s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:23:37 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-245c7bab-d3a3-417c-8527-9e407a2eb842 tempest-VolumeDependencyTests-448203194 None] Created reservations ['79f67bb4-a418-4a0b-9009-dd367a4d7920', '821f6333-ab53-42a8-85db-e4470bbb882f', 'c4a8df8a-b3c2-4ecb-be81-9fa281abdb42', '4605a5c7-4204-4e11-9d85-d729708b44cf'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:23:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-245c7bab-d3a3-417c-8527-9e407a2eb842 tempest-VolumeDependencyTests-448203194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:23:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-245c7bab-d3a3-417c-8527-9e407a2eb842 tempest-VolumeDependencyTests-448203194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:23:37 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-245c7bab-d3a3-417c-8527-9e407a2eb842 tempest-VolumeDependencyTests-448203194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:23:37 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-245c7bab-d3a3-417c-8527-9e407a2eb842 tempest-VolumeDependencyTests-448203194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:23:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-245c7bab-d3a3-417c-8527-9e407a2eb842 tempest-VolumeDependencyTests-448203194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:23:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-245c7bab-d3a3-417c-8527-9e407a2eb842 tempest-VolumeDependencyTests-448203194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:37 devstack sudo[91850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:23:37 devstack sudo[91850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:37 devstack sudo[91799]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0" returned: 0 in 1.150s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:37 devstack cinder-volume[83863]: DEBUG cinder.utils [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] Path /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-84b90bb8-64a1-4773-be63-0c5598db6607 not found in is_blk_device check {{(pid=83863) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 19:23:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-84b90bb8-64a1-4773-be63-0c5598db6607 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:37 devstack sudo[91859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-84b90bb8-64a1-4773-be63-0c5598db6607 Apr 28 19:23:37 devstack sudo[91859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:38 devstack sudo[91850]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-245c7bab-d3a3-417c-8527-9e407a2eb842 tempest-VolumeDependencyTests-448203194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.772s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:38 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-245c7bab-d3a3-417c-8527-9e407a2eb842 tempest-VolumeDependencyTests-448203194 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:23:38 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-245c7bab-d3a3-417c-8527-9e407a2eb842 tempest-VolumeDependencyTests-448203194 None] Deleted volume successfully. Apr 28 19:23:38 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-245c7bab-d3a3-417c-8527-9e407a2eb842 tempest-VolumeDependencyTests-448203194 None] Lock "cinder-bae102d6-65a9-4f6e-8196-ab74d4503878-delete_volume" released by "delete_volume" :: held 3.219s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:23:39 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-715913b7-df02-4406-bd6b-da4b2bfa5fee tempest-VolumeDependencyTests-448203194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:23:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-715913b7-df02-4406-bd6b-da4b2bfa5fee tempest-VolumeDependencyTests-448203194 None] Flow 'volume_create_manager' (6917d81d-39b3-4be9-878b-2bd5f54560d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:23:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-715913b7-df02-4406-bd6b-da4b2bfa5fee tempest-VolumeDependencyTests-448203194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e36e2fc0-61a1-45bc-81c0-f785dd41a7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-715913b7-df02-4406-bd6b-da4b2bfa5fee tempest-VolumeDependencyTests-448203194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e36e2fc0-61a1-45bc-81c0-f785dd41a7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-174158740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d509770-94ed-4304-bdf8-b17eb0e3a2c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff619ae26a3941c3bb83a36d3a29d9da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:23:39Z,use_quota=True,user_id='7c106efa0d134538838c2a28c50746c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-715913b7-df02-4406-bd6b-da4b2bfa5fee tempest-VolumeDependencyTests-448203194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7edbc0b-9a8b-4758-b862-c2e401508496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-715913b7-df02-4406-bd6b-da4b2bfa5fee tempest-VolumeDependencyTests-448203194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7edbc0b-9a8b-4758-b862-c2e401508496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-715913b7-df02-4406-bd6b-da4b2bfa5fee tempest-VolumeDependencyTests-448203194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94ffba67-13e5-44af-a3ca-8b87be20f4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-715913b7-df02-4406-bd6b-da4b2bfa5fee tempest-VolumeDependencyTests-448203194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94ffba67-13e5-44af-a3ca-8b87be20f4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d509770-94ed-4304-bdf8-b17eb0e3a2c1', 'volume_name': 'volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-715913b7-df02-4406-bd6b-da4b2bfa5fee tempest-VolumeDependencyTests-448203194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eee7d75-6a13-4e05-aae0-1bf0626b83d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-715913b7-df02-4406-bd6b-da4b2bfa5fee tempest-VolumeDependencyTests-448203194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eee7d75-6a13-4e05-aae0-1bf0626b83d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-715913b7-df02-4406-bd6b-da4b2bfa5fee tempest-VolumeDependencyTests-448203194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54896cfb-16fb-415d-b795-f4c8b0b5a294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:39 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-715913b7-df02-4406-bd6b-da4b2bfa5fee tempest-VolumeDependencyTests-448203194 None] Volume 9d509770-94ed-4304-bdf8-b17eb0e3a2c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1', 'volume_size': 1} Apr 28 19:23:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-715913b7-df02-4406-bd6b-da4b2bfa5fee tempest-VolumeDependencyTests-448203194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:23:44 devstack sudo[91859]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-84b90bb8-64a1-4773-be63-0c5598db6607" returned: 0 in 6.829s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:44 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b26e79f-4b8c-4f8c-b42d-2d88904a9e77]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:23:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:44 devstack sudo[91919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0 Apr 28 19:23:44 devstack sudo[91919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:45 devstack sudo[91919]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0" returned: 0 in 0.869s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:45 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] Image conversion details: src /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0, size 1024.00 MB, duration 6.83 sec, destination /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-84b90bb8-64a1-4773-be63-0c5598db6607 {{(pid=83863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 19:23:45 devstack cinder-volume[83863]: INFO cinder.image.image_utils [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] Converted 1024.00 MB image at 149.94 MB/s Apr 28 19:23:45 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-84b90bb8-64a1-4773-be63-0c5598db6607 is being set with open permissions: ugo+rw Apr 28 19:23:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-84b90bb8-64a1-4773-be63-0c5598db6607 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:45 devstack sudo[91924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-84b90bb8-64a1-4773-be63-0c5598db6607 Apr 28 19:23:45 devstack sudo[91924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:45 devstack sudo[91924]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-84b90bb8-64a1-4773-be63-0c5598db6607" returned: 0 in 0.597s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:45 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "cinder-quobyte-84b90bb8-64a1-4773-be63-0c5598db6607" released by "_copy_volume_from_snapshot" :: held 10.612s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:23:45 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "cinder-quobyte-0ea91114-9904-45d1-a7f9-44323efa3cce-84b90bb8-64a1-4773-be63-0c5598db6607" released by "_create_volume_from_snapshot" :: held 10.642s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:23:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.657s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:23:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-715913b7-df02-4406-bd6b-da4b2bfa5fee tempest-VolumeDependencyTests-448203194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.569s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:23:45 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-715913b7-df02-4406-bd6b-da4b2bfa5fee tempest-VolumeDependencyTests-448203194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-174158740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d509770-94ed-4304-bdf8-b17eb0e3a2c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff619ae26a3941c3bb83a36d3a29d9da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:23:39Z,use_quota=True,user_id='7c106efa0d134538838c2a28c50746c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:23:45 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-715913b7-df02-4406-bd6b-da4b2bfa5fee tempest-VolumeDependencyTests-448203194 None] Creating volume 9d509770-94ed-4304-bdf8-b17eb0e3a2c1 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:23:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-715913b7-df02-4406-bd6b-da4b2bfa5fee tempest-VolumeDependencyTests-448203194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:23:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-715913b7-df02-4406-bd6b-da4b2bfa5fee tempest-VolumeDependencyTests-448203194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:23:45 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-715913b7-df02-4406-bd6b-da4b2bfa5fee tempest-VolumeDependencyTests-448203194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:23:45 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-715913b7-df02-4406-bd6b-da4b2bfa5fee tempest-VolumeDependencyTests-448203194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:23:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-715913b7-df02-4406-bd6b-da4b2bfa5fee tempest-VolumeDependencyTests-448203194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:23:45 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-715913b7-df02-4406-bd6b-da4b2bfa5fee tempest-VolumeDependencyTests-448203194 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:23:45 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-715913b7-df02-4406-bd6b-da4b2bfa5fee tempest-VolumeDependencyTests-448203194 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:23:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-715913b7-df02-4406-bd6b-da4b2bfa5fee tempest-VolumeDependencyTests-448203194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:45 devstack sudo[91927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1 1073741824 Apr 28 19:23:45 devstack sudo[91927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7965610e-93c1-45e8-884a-79e4f386dab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84b90bb8-64a1-4773-be63-0c5598db6607', 'volume_size': 2, 'snapshot_id': '0ea91114-9904-45d1-a7f9-44323efa3cce'}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eed8d3d2-32f5-4735-8c63-c80190f47cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:45 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] Volume volume-84b90bb8-64a1-4773-be63-0c5598db6607 (84b90bb8-64a1-4773-be63-0c5598db6607): created successfully Apr 28 19:23:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eed8d3d2-32f5-4735-8c63-c80190f47cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] Flow 'volume_create_manager' (5450ca2e-6e62-46a1-8d85-fe812bd5fb63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:23:45 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-6f9d2e74-a61b-49b2-8cc7-ac7bdc9ac9e2 tempest-VolumesSnapshotTestJSON-389413737 None] Created volume successfully. Apr 28 19:23:46 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-48075ba2-0b66-4a2c-8a14-a17fa096d6bb tempest-VolumesSnapshotTestJSON-389413737 None] Acquiring lock "cinder-84b90bb8-64a1-4773-be63-0c5598db6607-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:23:46 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-48075ba2-0b66-4a2c-8a14-a17fa096d6bb tempest-VolumesSnapshotTestJSON-389413737 None] Lock "cinder-84b90bb8-64a1-4773-be63-0c5598db6607-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:23:46 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-48075ba2-0b66-4a2c-8a14-a17fa096d6bb tempest-VolumesSnapshotTestJSON-389413737 None] Acquiring lock "cinder-quobyte-84b90bb8-64a1-4773-be63-0c5598db6607" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:23:46 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-48075ba2-0b66-4a2c-8a14-a17fa096d6bb tempest-VolumesSnapshotTestJSON-389413737 None] Lock "cinder-quobyte-84b90bb8-64a1-4773-be63-0c5598db6607" acquired by "delete_volume" :: waited 0.016s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:23:46 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[990dbcd7-bef7-4c5b-aa44-0a4d59a41f1b]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:23:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-48075ba2-0b66-4a2c-8a14-a17fa096d6bb tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-84b90bb8-64a1-4773-be63-0c5598db6607 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:46 devstack sudo[91939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-84b90bb8-64a1-4773-be63-0c5598db6607 Apr 28 19:23:46 devstack sudo[91939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:46 devstack sudo[91927]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-715913b7-df02-4406-bd6b-da4b2bfa5fee tempest-VolumeDependencyTests-448203194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1 1073741824" returned: 0 in 0.919s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-715913b7-df02-4406-bd6b-da4b2bfa5fee tempest-VolumeDependencyTests-448203194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:46 devstack sudo[91942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1 Apr 28 19:23:46 devstack sudo[91942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:47 devstack sudo[91939]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-48075ba2-0b66-4a2c-8a14-a17fa096d6bb tempest-VolumesSnapshotTestJSON-389413737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-84b90bb8-64a1-4773-be63-0c5598db6607" returned: 0 in 0.744s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-48075ba2-0b66-4a2c-8a14-a17fa096d6bb tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-84b90bb8-64a1-4773-be63-0c5598db6607 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:47 devstack sudo[91947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-84b90bb8-64a1-4773-be63-0c5598db6607 Apr 28 19:23:47 devstack sudo[91947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:47 devstack sudo[91942]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-715913b7-df02-4406-bd6b-da4b2bfa5fee tempest-VolumeDependencyTests-448203194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1" returned: 0 in 0.630s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:47 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-715913b7-df02-4406-bd6b-da4b2bfa5fee tempest-VolumeDependencyTests-448203194 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:23:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-715913b7-df02-4406-bd6b-da4b2bfa5fee tempest-VolumeDependencyTests-448203194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.589s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:23:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-715913b7-df02-4406-bd6b-da4b2bfa5fee tempest-VolumeDependencyTests-448203194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54896cfb-16fb-415d-b795-f4c8b0b5a294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-715913b7-df02-4406-bd6b-da4b2bfa5fee tempest-VolumeDependencyTests-448203194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6df9746c-2a38-4532-97ab-40533868a2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:47 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-715913b7-df02-4406-bd6b-da4b2bfa5fee tempest-VolumeDependencyTests-448203194 None] Volume volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1 (9d509770-94ed-4304-bdf8-b17eb0e3a2c1): created successfully Apr 28 19:23:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-715913b7-df02-4406-bd6b-da4b2bfa5fee tempest-VolumeDependencyTests-448203194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6df9746c-2a38-4532-97ab-40533868a2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-715913b7-df02-4406-bd6b-da4b2bfa5fee tempest-VolumeDependencyTests-448203194 None] Flow 'volume_create_manager' (6917d81d-39b3-4be9-878b-2bd5f54560d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:23:47 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-715913b7-df02-4406-bd6b-da4b2bfa5fee tempest-VolumeDependencyTests-448203194 None] Created volume successfully. Apr 28 19:23:47 devstack sudo[91947]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-48075ba2-0b66-4a2c-8a14-a17fa096d6bb tempest-VolumesSnapshotTestJSON-389413737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-84b90bb8-64a1-4773-be63-0c5598db6607" returned: 0 in 0.620s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-48075ba2-0b66-4a2c-8a14-a17fa096d6bb tempest-VolumesSnapshotTestJSON-389413737 None] Lock "cinder-quobyte-84b90bb8-64a1-4773-be63-0c5598db6607" released by "delete_volume" :: held 1.413s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:23:48 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-48075ba2-0b66-4a2c-8a14-a17fa096d6bb tempest-VolumesSnapshotTestJSON-389413737 None] Created reservations ['1bfcd891-6644-43a7-9175-93d6fae1158b', '6b7bc5af-89f5-47ee-87e3-d45480502a7b', '9e2aed57-4d65-48ac-a631-b87791d9304c', 'e982ee6d-6ddf-4f75-b0cb-ca2677b2f8f4'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:23:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-48075ba2-0b66-4a2c-8a14-a17fa096d6bb tempest-VolumesSnapshotTestJSON-389413737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:23:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-48075ba2-0b66-4a2c-8a14-a17fa096d6bb tempest-VolumesSnapshotTestJSON-389413737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:23:48 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-48075ba2-0b66-4a2c-8a14-a17fa096d6bb tempest-VolumesSnapshotTestJSON-389413737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:23:48 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-48075ba2-0b66-4a2c-8a14-a17fa096d6bb tempest-VolumesSnapshotTestJSON-389413737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:23:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-48075ba2-0b66-4a2c-8a14-a17fa096d6bb tempest-VolumesSnapshotTestJSON-389413737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:23:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-48075ba2-0b66-4a2c-8a14-a17fa096d6bb tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:48 devstack sudo[91952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:23:48 devstack sudo[91952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:48 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:23:48 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Flow 'volume_create_manager' (43e7a98e-e295-495c-90ab-5ff19c0ba101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:23:48 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c29930cb-041e-4751-a91f-4b0e374528d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:48 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c29930cb-041e-4751-a91f-4b0e374528d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-614281348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=016f2202-6c90-4049-9982-e91567dc92b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff619ae26a3941c3bb83a36d3a29d9da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=9d509770-94ed-4304-bdf8-b17eb0e3a2c1,status='creating',terminated_at=None,updated_at=2026-04-28T17:23:48Z,use_quota=True,user_id='7c106efa0d134538838c2a28c50746c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:48 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a21f8e5-a18e-45f4-8f8c-9fd4423861b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:48 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a21f8e5-a18e-45f4-8f8c-9fd4423861b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:48 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8ad5023-7577-49a5-b989-2848d2b9e8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:48 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8ad5023-7577-49a5-b989-2848d2b9e8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '016f2202-6c90-4049-9982-e91567dc92b2', 'volume_name': 'volume-016f2202-6c90-4049-9982-e91567dc92b2', 'volume_size': 1, 'source_volid': '9d509770-94ed-4304-bdf8-b17eb0e3a2c1', 'source_volstatus': 'available'}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:48 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f4b40f5-b37f-4d2e-8ec4-2dd3d3e5e693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:48 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f4b40f5-b37f-4d2e-8ec4-2dd3d3e5e693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:48 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1959c1b0-b393-4849-ac9a-07567826f3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:48 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Volume 016f2202-6c90-4049-9982-e91567dc92b2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-016f2202-6c90-4049-9982-e91567dc92b2', 'volume_size': 1, 'source_volid': '9d509770-94ed-4304-bdf8-b17eb0e3a2c1', 'source_volstatus': 'available'} Apr 28 19:23:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:23:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:23:48 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Cloning volume 9d509770-94ed-4304-bdf8-b17eb0e3a2c1 to volume 016f2202-6c90-4049-9982-e91567dc92b2 Apr 28 19:23:48 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Creating offline snapshot de28a842-f76f-4ad1-950a-f1a34c08fcd0 of volume 9d509770-94ed-4304-bdf8-b17eb0e3a2c1 {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 19:23:48 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9c9922-2def-487d-8c4c-c65ee3bcc541]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:23:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:48 devstack sudo[91954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1 Apr 28 19:23:48 devstack sudo[91954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:48 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a2c1479b-2aee-483c-8003-571d465f13ba tempest-VolumesSnapshotTestJSON-389413737 None] Acquiring lock "cinder-0ea91114-9904-45d1-a7f9-44323efa3cce-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:23:48 devstack sudo[91952]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-48075ba2-0b66-4a2c-8a14-a17fa096d6bb tempest-VolumesSnapshotTestJSON-389413737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.664s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:48 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-48075ba2-0b66-4a2c-8a14-a17fa096d6bb tempest-VolumesSnapshotTestJSON-389413737 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:23:48 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-48075ba2-0b66-4a2c-8a14-a17fa096d6bb tempest-VolumesSnapshotTestJSON-389413737 None] Deleted volume successfully. Apr 28 19:23:48 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a2c1479b-2aee-483c-8003-571d465f13ba tempest-VolumesSnapshotTestJSON-389413737 None] Lock "cinder-0ea91114-9904-45d1-a7f9-44323efa3cce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:23:48 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a2c1479b-2aee-483c-8003-571d465f13ba tempest-VolumesSnapshotTestJSON-389413737 None] Acquiring lock "cinder-quobyte-70889c45-9ce2-4bf9-b757-afc1275279d0" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:23:48 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a2c1479b-2aee-483c-8003-571d465f13ba tempest-VolumesSnapshotTestJSON-389413737 None] Lock "cinder-quobyte-70889c45-9ce2-4bf9-b757-afc1275279d0" acquired by "delete_snapshot" :: waited 0.033s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:23:48 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a2c1479b-2aee-483c-8003-571d465f13ba tempest-VolumesSnapshotTestJSON-389413737 None] Acquiring lock "cinder-quobyte-0ea91114-9904-45d1-a7f9-44323efa3cce" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:23:48 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-48075ba2-0b66-4a2c-8a14-a17fa096d6bb tempest-VolumesSnapshotTestJSON-389413737 None] Lock "cinder-84b90bb8-64a1-4773-be63-0c5598db6607-delete_volume" released by "delete_volume" :: held 2.374s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:23:48 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a2c1479b-2aee-483c-8003-571d465f13ba tempest-VolumesSnapshotTestJSON-389413737 None] Lock "cinder-quobyte-0ea91114-9904-45d1-a7f9-44323efa3cce" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:23:48 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-a2c1479b-2aee-483c-8003-571d465f13ba tempest-VolumesSnapshotTestJSON-389413737 None] Deleting offline snapshot 0ea91114-9904-45d1-a7f9-44323efa3cce of volume 70889c45-9ce2-4bf9-b757-afc1275279d0 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 19:23:48 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-a2c1479b-2aee-483c-8003-571d465f13ba tempest-VolumesSnapshotTestJSON-389413737 None] snapshot_file for this snap is: volume-70889c45-9ce2-4bf9-b757-afc1275279d0.0ea91114-9904-45d1-a7f9-44323efa3cce {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 19:23:48 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fb99cc-f3cc-49d1-b970-d7e202b83b67]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:23:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a2c1479b-2aee-483c-8003-571d465f13ba tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0.0ea91114-9904-45d1-a7f9-44323efa3cce {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:49 devstack sudo[91957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0.0ea91114-9904-45d1-a7f9-44323efa3cce Apr 28 19:23:49 devstack sudo[91957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:49 devstack sudo[91954]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1" returned: 0 in 0.852s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1.de28a842-f76f-4ad1-950a-f1a34c08fcd0 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:49 devstack sudo[91962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1.de28a842-f76f-4ad1-950a-f1a34c08fcd0 1G Apr 28 19:23:49 devstack sudo[91962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:49 devstack sudo[91957]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a2c1479b-2aee-483c-8003-571d465f13ba tempest-VolumesSnapshotTestJSON-389413737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0.0ea91114-9904-45d1-a7f9-44323efa3cce" returned: 0 in 0.734s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:49 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-a2c1479b-2aee-483c-8003-571d465f13ba tempest-VolumesSnapshotTestJSON-389413737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70889c45-9ce2-4bf9-b757-afc1275279d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:23:49 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb32eee6-bf34-445c-bb0d-1a09f2101838]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:23:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a2c1479b-2aee-483c-8003-571d465f13ba tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:49 devstack sudo[91967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0 Apr 28 19:23:49 devstack sudo[91967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:50 devstack sudo[91962]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1.de28a842-f76f-4ad1-950a-f1a34c08fcd0 1G" returned: 0 in 0.832s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1.de28a842-f76f-4ad1-950a-f1a34c08fcd0 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:50 devstack sudo[91974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1.de28a842-f76f-4ad1-950a-f1a34c08fcd0 Apr 28 19:23:50 devstack sudo[91974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:50 devstack sudo[91967]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a2c1479b-2aee-483c-8003-571d465f13ba tempest-VolumesSnapshotTestJSON-389413737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0" returned: 0 in 0.823s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a2c1479b-2aee-483c-8003-571d465f13ba tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0.0ea91114-9904-45d1-a7f9-44323efa3cce {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:50 devstack sudo[91980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0.0ea91114-9904-45d1-a7f9-44323efa3cce Apr 28 19:23:50 devstack sudo[91980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:50 devstack sudo[91974]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1.de28a842-f76f-4ad1-950a-f1a34c08fcd0" returned: 0 in 0.715s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:50 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1.de28a842-f76f-4ad1-950a-f1a34c08fcd0 is being set with open permissions: ugo+rw Apr 28 19:23:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1.de28a842-f76f-4ad1-950a-f1a34c08fcd0 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:50 devstack sudo[91986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1.de28a842-f76f-4ad1-950a-f1a34c08fcd0 Apr 28 19:23:50 devstack sudo[91986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:51 devstack sudo[91980]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a2c1479b-2aee-483c-8003-571d465f13ba tempest-VolumesSnapshotTestJSON-389413737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0.0ea91114-9904-45d1-a7f9-44323efa3cce" returned: 0 in 0.767s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a2c1479b-2aee-483c-8003-571d465f13ba tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0.0ea91114-9904-45d1-a7f9-44323efa3cce {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:51 devstack sudo[91993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0.0ea91114-9904-45d1-a7f9-44323efa3cce Apr 28 19:23:51 devstack sudo[91993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:51 devstack sudo[91986]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1.de28a842-f76f-4ad1-950a-f1a34c08fcd0" returned: 0 in 0.631s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:51 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:SELECT=99,cinder:INSERT=26,cinder:UPDATE=101,cinder:DELETE=10 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 19:23:51 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:INSERT=23,cinder:UPDATE=103,cinder:SELECT=83,cinder:DELETE=10 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 19:23:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:51 devstack sudo[91996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1.info Apr 28 19:23:51 devstack sudo[91996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:51 devstack sudo[91993]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a2c1479b-2aee-483c-8003-571d465f13ba tempest-VolumesSnapshotTestJSON-389413737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0.0ea91114-9904-45d1-a7f9-44323efa3cce" returned: 0 in 0.648s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:51 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a2c1479b-2aee-483c-8003-571d465f13ba tempest-VolumesSnapshotTestJSON-389413737 None] Lock "cinder-quobyte-0ea91114-9904-45d1-a7f9-44323efa3cce" released by "_delete_snapshot" :: held 3.104s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:23:51 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a2c1479b-2aee-483c-8003-571d465f13ba tempest-VolumesSnapshotTestJSON-389413737 None] Lock "cinder-quobyte-70889c45-9ce2-4bf9-b757-afc1275279d0" released by "delete_snapshot" :: held 3.138s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:23:52 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-a2c1479b-2aee-483c-8003-571d465f13ba tempest-VolumesSnapshotTestJSON-389413737 None] Created reservations ['d7fe699c-7be6-4944-9443-aa3f52662e22', '1632f176-27c7-4653-873b-c85d182b3ee6', 'a54fcedf-5eaf-4f3a-9541-f20ca50d2c9b', 'd1558f48-c8fb-4943-9de1-09bc65040fba'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:23:52 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-a2c1479b-2aee-483c-8003-571d465f13ba tempest-VolumesSnapshotTestJSON-389413737 None] Delete snapshot completed successfully. Apr 28 19:23:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a2c1479b-2aee-483c-8003-571d465f13ba tempest-VolumesSnapshotTestJSON-389413737 None] Lock "cinder-0ea91114-9904-45d1-a7f9-44323efa3cce-delete_snapshot" released by "delete_snapshot" :: held 3.334s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:23:52 devstack sudo[91996]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1.info" returned: 0 in 0.640s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:52 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1.info is being set with open permissions: ugo+rw Apr 28 19:23:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:52 devstack sudo[92000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1.info Apr 28 19:23:52 devstack sudo[92000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:52 devstack sudo[92000]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1.info" returned: 0 in 0.634s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Acquiring lock "cinder-quobyte-016f2202-6c90-4049-9982-e91567dc92b2" by "_copy_volume_from_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:23:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Lock "cinder-quobyte-016f2202-6c90-4049-9982-e91567dc92b2" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:23:52 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] snapshot: de28a842-f76f-4ad1-950a-f1a34c08fcd0, volume: 016f2202-6c90-4049-9982-e91567dc92b2, {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 19:23:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:23:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:23:52 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:23:52 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:23:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:23:52 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[76340386-2fa6-49e1-80ab-07e6e563b18d]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:23:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1.de28a842-f76f-4ad1-950a-f1a34c08fcd0 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:53 devstack sudo[92003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1.de28a842-f76f-4ad1-950a-f1a34c08fcd0 Apr 28 19:23:53 devstack sudo[92003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:53 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-678615b3-7cba-420c-812d-c0b4aa9928c1 tempest-VolumesSnapshotTestJSON-389413737 None] Acquiring lock "cinder-70889c45-9ce2-4bf9-b757-afc1275279d0-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:23:53 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-678615b3-7cba-420c-812d-c0b4aa9928c1 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "cinder-70889c45-9ce2-4bf9-b757-afc1275279d0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:23:53 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-678615b3-7cba-420c-812d-c0b4aa9928c1 tempest-VolumesSnapshotTestJSON-389413737 None] Acquiring lock "cinder-quobyte-70889c45-9ce2-4bf9-b757-afc1275279d0" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:23:53 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-678615b3-7cba-420c-812d-c0b4aa9928c1 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "cinder-quobyte-70889c45-9ce2-4bf9-b757-afc1275279d0" acquired by "delete_volume" :: waited 0.017s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:23:53 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cef4a22-2201-44b0-a4e0-302e5d2b4542]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:23:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-678615b3-7cba-420c-812d-c0b4aa9928c1 tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:53 devstack sudo[92005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0 Apr 28 19:23:53 devstack sudo[92005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:53 devstack sudo[92003]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1.de28a842-f76f-4ad1-950a-f1a34c08fcd0" returned: 0 in 0.857s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:53 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:23:53 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1 {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 19:23:53 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Creating direct copy from snapshot {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 19:23:53 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b941f3-9852-4d5c-bb3c-3667916de6b3]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:23:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:53 devstack sudo[92010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1 Apr 28 19:23:53 devstack sudo[92010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:54 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3e2cdba1-999b-4ce3-ba65-f41a9d8764d8 tempest-VolumesNegativeTest-1079561226 None] Acquiring lock "cinder-4f18b232-b8ea-4c90-ab50-073397a03094-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:23:54 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3e2cdba1-999b-4ce3-ba65-f41a9d8764d8 tempest-VolumesNegativeTest-1079561226 None] Lock "cinder-4f18b232-b8ea-4c90-ab50-073397a03094-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:23:54 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3e2cdba1-999b-4ce3-ba65-f41a9d8764d8 tempest-VolumesNegativeTest-1079561226 None] Acquiring lock "cinder-quobyte-4f18b232-b8ea-4c90-ab50-073397a03094" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:23:54 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3e2cdba1-999b-4ce3-ba65-f41a9d8764d8 tempest-VolumesNegativeTest-1079561226 None] Lock "cinder-quobyte-4f18b232-b8ea-4c90-ab50-073397a03094" acquired by "delete_volume" :: waited 0.030s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:23:54 devstack sudo[92005]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-678615b3-7cba-420c-812d-c0b4aa9928c1 tempest-VolumesSnapshotTestJSON-389413737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0" returned: 0 in 0.848s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-678615b3-7cba-420c-812d-c0b4aa9928c1 tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:54 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b51e45-9a6d-4e3c-a787-f6b09f9fffc3]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:23:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e2cdba1-999b-4ce3-ba65-f41a9d8764d8 tempest-VolumesNegativeTest-1079561226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4f18b232-b8ea-4c90-ab50-073397a03094 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:54 devstack sudo[92015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0 Apr 28 19:23:54 devstack sudo[92015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:54 devstack sudo[92016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4f18b232-b8ea-4c90-ab50-073397a03094 Apr 28 19:23:54 devstack sudo[92016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:54 devstack sudo[92010]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1" returned: 0 in 0.841s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:54 devstack cinder-volume[83863]: DEBUG cinder.utils [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Path /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-016f2202-6c90-4049-9982-e91567dc92b2 not found in is_blk_device check {{(pid=83863) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 19:23:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-016f2202-6c90-4049-9982-e91567dc92b2 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:54 devstack sudo[92023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-016f2202-6c90-4049-9982-e91567dc92b2 Apr 28 19:23:54 devstack sudo[92023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:54 devstack sudo[92015]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-678615b3-7cba-420c-812d-c0b4aa9928c1 tempest-VolumesSnapshotTestJSON-389413737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-70889c45-9ce2-4bf9-b757-afc1275279d0" returned: 0 in 0.623s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:54 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-678615b3-7cba-420c-812d-c0b4aa9928c1 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "cinder-quobyte-70889c45-9ce2-4bf9-b757-afc1275279d0" released by "delete_volume" :: held 1.561s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:23:54 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-678615b3-7cba-420c-812d-c0b4aa9928c1 tempest-VolumesSnapshotTestJSON-389413737 None] Created reservations ['606ac583-d610-4f31-9653-f354295cdb37', '412c470e-1048-4459-ad77-b8bc2d10d120', '5c31d200-2697-43be-aaaf-9c1710bd4396', '0f5abc39-e78f-46f3-bca9-852efcb622e4'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:23:54 devstack sudo[92016]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e2cdba1-999b-4ce3-ba65-f41a9d8764d8 tempest-VolumesNegativeTest-1079561226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4f18b232-b8ea-4c90-ab50-073397a03094" returned: 0 in 0.785s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e2cdba1-999b-4ce3-ba65-f41a9d8764d8 tempest-VolumesNegativeTest-1079561226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4f18b232-b8ea-4c90-ab50-073397a03094 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-678615b3-7cba-420c-812d-c0b4aa9928c1 tempest-VolumesSnapshotTestJSON-389413737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:23:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-678615b3-7cba-420c-812d-c0b4aa9928c1 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:23:54 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-678615b3-7cba-420c-812d-c0b4aa9928c1 tempest-VolumesSnapshotTestJSON-389413737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:23:54 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-678615b3-7cba-420c-812d-c0b4aa9928c1 tempest-VolumesSnapshotTestJSON-389413737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:23:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-678615b3-7cba-420c-812d-c0b4aa9928c1 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:23:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-678615b3-7cba-420c-812d-c0b4aa9928c1 tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:54 devstack sudo[92030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4f18b232-b8ea-4c90-ab50-073397a03094 Apr 28 19:23:54 devstack sudo[92030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:54 devstack sudo[92031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:23:54 devstack sudo[92031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:55 devstack sudo[92031]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-678615b3-7cba-420c-812d-c0b4aa9928c1 tempest-VolumesSnapshotTestJSON-389413737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.753s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:55 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-678615b3-7cba-420c-812d-c0b4aa9928c1 tempest-VolumesSnapshotTestJSON-389413737 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:23:55 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-678615b3-7cba-420c-812d-c0b4aa9928c1 tempest-VolumesSnapshotTestJSON-389413737 None] Deleted volume successfully. Apr 28 19:23:55 devstack sudo[92030]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e2cdba1-999b-4ce3-ba65-f41a9d8764d8 tempest-VolumesNegativeTest-1079561226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-4f18b232-b8ea-4c90-ab50-073397a03094" returned: 0 in 0.847s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:55 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3e2cdba1-999b-4ce3-ba65-f41a9d8764d8 tempest-VolumesNegativeTest-1079561226 None] Lock "cinder-quobyte-4f18b232-b8ea-4c90-ab50-073397a03094" released by "delete_volume" :: held 1.713s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:23:55 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-678615b3-7cba-420c-812d-c0b4aa9928c1 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "cinder-70889c45-9ce2-4bf9-b757-afc1275279d0-delete_volume" released by "delete_volume" :: held 2.706s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:23:56 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-3e2cdba1-999b-4ce3-ba65-f41a9d8764d8 tempest-VolumesNegativeTest-1079561226 None] Created reservations ['8f6d40f5-48e9-47d4-9dcf-550802c083fe', '29684527-0ab2-429a-bf95-70881c756d19', '400f5ed7-acf6-4309-9d28-0a1dbc360770', 'a808ec01-ecc9-407b-970b-a98f9af529b9'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:23:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3e2cdba1-999b-4ce3-ba65-f41a9d8764d8 tempest-VolumesNegativeTest-1079561226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:23:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3e2cdba1-999b-4ce3-ba65-f41a9d8764d8 tempest-VolumesNegativeTest-1079561226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:23:56 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3e2cdba1-999b-4ce3-ba65-f41a9d8764d8 tempest-VolumesNegativeTest-1079561226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:23:56 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3e2cdba1-999b-4ce3-ba65-f41a9d8764d8 tempest-VolumesNegativeTest-1079561226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:23:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3e2cdba1-999b-4ce3-ba65-f41a9d8764d8 tempest-VolumesNegativeTest-1079561226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:23:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e2cdba1-999b-4ce3-ba65-f41a9d8764d8 tempest-VolumesNegativeTest-1079561226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:23:56 devstack sudo[92047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:23:56 devstack sudo[92047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:23:56 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-51062a32-91b9-49d4-acb4-81e18cda8ba3 tempest-VolumesSnapshotTestJSON-389413737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:23:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-51062a32-91b9-49d4-acb4-81e18cda8ba3 tempest-VolumesSnapshotTestJSON-389413737 None] Flow 'volume_create_manager' (df5ae9d2-4ff2-45a7-893b-4ef9862798ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:23:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-51062a32-91b9-49d4-acb4-81e18cda8ba3 tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4e8178a-7d3b-4803-b858-ba7205b5d0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-51062a32-91b9-49d4-acb4-81e18cda8ba3 tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4e8178a-7d3b-4803-b858-ba7205b5d0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-516815961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20b63c40-b40a-41dc-8425-e733c9f01358,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcd7eac94c09403f92b066b388f6d053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:23:56Z,use_quota=True,user_id='57349484d0c543c39251044039afccea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-51062a32-91b9-49d4-acb4-81e18cda8ba3 tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ad0f6e2-a5bc-49b4-aa0c-6952d1a8d074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-51062a32-91b9-49d4-acb4-81e18cda8ba3 tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ad0f6e2-a5bc-49b4-aa0c-6952d1a8d074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-51062a32-91b9-49d4-acb4-81e18cda8ba3 tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d156790-0e49-4fc4-a936-283083ccec69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-51062a32-91b9-49d4-acb4-81e18cda8ba3 tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d156790-0e49-4fc4-a936-283083ccec69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20b63c40-b40a-41dc-8425-e733c9f01358', 'volume_name': 'volume-20b63c40-b40a-41dc-8425-e733c9f01358', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-51062a32-91b9-49d4-acb4-81e18cda8ba3 tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0c68c1b-6875-47ba-8ec9-ffa63dec1e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-51062a32-91b9-49d4-acb4-81e18cda8ba3 tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0c68c1b-6875-47ba-8ec9-ffa63dec1e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:23:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-51062a32-91b9-49d4-acb4-81e18cda8ba3 tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (436446d0-1026-48f5-8a96-1c5b4b9a5e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:23:56 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-51062a32-91b9-49d4-acb4-81e18cda8ba3 tempest-VolumesSnapshotTestJSON-389413737 None] Volume 20b63c40-b40a-41dc-8425-e733c9f01358: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20b63c40-b40a-41dc-8425-e733c9f01358', 'volume_size': 1} Apr 28 19:23:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-51062a32-91b9-49d4-acb4-81e18cda8ba3 tempest-VolumesSnapshotTestJSON-389413737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:23:57 devstack sudo[92047]: pam_unix(sudo:session): session closed for user root Apr 28 19:23:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e2cdba1-999b-4ce3-ba65-f41a9d8764d8 tempest-VolumesNegativeTest-1079561226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 1.073s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:23:57 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-3e2cdba1-999b-4ce3-ba65-f41a9d8764d8 tempest-VolumesNegativeTest-1079561226 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:23:57 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-3e2cdba1-999b-4ce3-ba65-f41a9d8764d8 tempest-VolumesNegativeTest-1079561226 None] Deleted volume successfully. Apr 28 19:23:57 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3e2cdba1-999b-4ce3-ba65-f41a9d8764d8 tempest-VolumesNegativeTest-1079561226 None] Lock "cinder-4f18b232-b8ea-4c90-ab50-073397a03094-delete_volume" released by "delete_volume" :: held 3.354s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:24:00 devstack sudo[92023]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-016f2202-6c90-4049-9982-e91567dc92b2" returned: 0 in 5.682s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:00 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3eac4e-1ea7-48b1-aa25-de842d9bcb54]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:24:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:00 devstack sudo[92051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1 Apr 28 19:24:00 devstack sudo[92051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:01 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-41ef0146-74f3-4efb-bbe7-b1b1a9b111f9 tempest-VolumesSnapshotListTestJSON-1261208981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:24:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-41ef0146-74f3-4efb-bbe7-b1b1a9b111f9 tempest-VolumesSnapshotListTestJSON-1261208981 None] Flow 'volume_create_manager' (7a315fef-a906-4567-8973-6fbeeba909f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:24:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-41ef0146-74f3-4efb-bbe7-b1b1a9b111f9 tempest-VolumesSnapshotListTestJSON-1261208981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (088a4509-b9e2-4528-8cf0-c1e1031b3720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-41ef0146-74f3-4efb-bbe7-b1b1a9b111f9 tempest-VolumesSnapshotListTestJSON-1261208981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (088a4509-b9e2-4528-8cf0-c1e1031b3720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-728133882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95dcbb59-8600-48a6-84a5-3be97022c9e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41f3ffbb83d1410a8c53ec19487c6f5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:24:01Z,use_quota=True,user_id='b091830fa08c4b25973b7c5fd7e8170f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:24:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-41ef0146-74f3-4efb-bbe7-b1b1a9b111f9 tempest-VolumesSnapshotListTestJSON-1261208981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7946883f-67a1-4eea-bf25-6b10c3994f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-41ef0146-74f3-4efb-bbe7-b1b1a9b111f9 tempest-VolumesSnapshotListTestJSON-1261208981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7946883f-67a1-4eea-bf25-6b10c3994f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:24:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-41ef0146-74f3-4efb-bbe7-b1b1a9b111f9 tempest-VolumesSnapshotListTestJSON-1261208981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e677123-fc45-46a4-b4b1-31d3e49187e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-41ef0146-74f3-4efb-bbe7-b1b1a9b111f9 tempest-VolumesSnapshotListTestJSON-1261208981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e677123-fc45-46a4-b4b1-31d3e49187e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95dcbb59-8600-48a6-84a5-3be97022c9e7', 'volume_name': 'volume-95dcbb59-8600-48a6-84a5-3be97022c9e7', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:24:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-41ef0146-74f3-4efb-bbe7-b1b1a9b111f9 tempest-VolumesSnapshotListTestJSON-1261208981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c726f70-f0c3-4221-9683-371d230a864c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-41ef0146-74f3-4efb-bbe7-b1b1a9b111f9 tempest-VolumesSnapshotListTestJSON-1261208981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c726f70-f0c3-4221-9683-371d230a864c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:24:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-41ef0146-74f3-4efb-bbe7-b1b1a9b111f9 tempest-VolumesSnapshotListTestJSON-1261208981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0475e179-ec99-4152-b4fc-c74efa5950fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:01 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-41ef0146-74f3-4efb-bbe7-b1b1a9b111f9 tempest-VolumesSnapshotListTestJSON-1261208981 None] Volume 95dcbb59-8600-48a6-84a5-3be97022c9e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95dcbb59-8600-48a6-84a5-3be97022c9e7', 'volume_size': 1} Apr 28 19:24:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-41ef0146-74f3-4efb-bbe7-b1b1a9b111f9 tempest-VolumesSnapshotListTestJSON-1261208981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:24:01 devstack sudo[92051]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1" returned: 0 in 0.956s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:01 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Image conversion details: src /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1, size 1024.00 MB, duration 5.68 sec, destination /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-016f2202-6c90-4049-9982-e91567dc92b2 {{(pid=83863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 19:24:01 devstack cinder-volume[83863]: INFO cinder.image.image_utils [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Converted 1024.00 MB image at 180.18 MB/s Apr 28 19:24:01 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-016f2202-6c90-4049-9982-e91567dc92b2 is being set with open permissions: ugo+rw Apr 28 19:24:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-016f2202-6c90-4049-9982-e91567dc92b2 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:01 devstack sudo[92057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-016f2202-6c90-4049-9982-e91567dc92b2 Apr 28 19:24:01 devstack sudo[92057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:01 devstack sudo[92057]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-016f2202-6c90-4049-9982-e91567dc92b2" returned: 0 in 0.601s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:01 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Lock "cinder-quobyte-016f2202-6c90-4049-9982-e91567dc92b2" released by "_copy_volume_from_snapshot" :: held 9.037s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:24:01 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Acquiring lock "cinder-quobyte-de28a842-f76f-4ad1-950a-f1a34c08fcd0" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:24:01 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Lock "cinder-quobyte-de28a842-f76f-4ad1-950a-f1a34c08fcd0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:24:01 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Deleting offline snapshot de28a842-f76f-4ad1-950a-f1a34c08fcd0 of volume 9d509770-94ed-4304-bdf8-b17eb0e3a2c1 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 19:24:01 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] snapshot_file for this snap is: volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1.de28a842-f76f-4ad1-950a-f1a34c08fcd0 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 19:24:01 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[24241437-a77b-41f5-b324-498b57af9d36]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:24:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1.de28a842-f76f-4ad1-950a-f1a34c08fcd0 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:02 devstack sudo[92060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1.de28a842-f76f-4ad1-950a-f1a34c08fcd0 Apr 28 19:24:02 devstack sudo[92060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:02 devstack sudo[92060]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1.de28a842-f76f-4ad1-950a-f1a34c08fcd0" returned: 0 in 0.748s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:02 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:24:02 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b4c96c-36f8-4c51-9904-615fbe9a2125]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:24:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:02 devstack sudo[92066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1 Apr 28 19:24:02 devstack sudo[92066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:03 devstack cinder-volume[83863]: DEBUG oslo_service.periodic_task [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 28 19:24:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:24:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:24:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:24:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:24:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:24:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:03 devstack sudo[92071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:24:03 devstack sudo[92071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:03 devstack sudo[92066]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1" returned: 0 in 0.722s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1.de28a842-f76f-4ad1-950a-f1a34c08fcd0 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:03 devstack sudo[92073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1.de28a842-f76f-4ad1-950a-f1a34c08fcd0 Apr 28 19:24:03 devstack sudo[92073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:04 devstack sudo[92071]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.631s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:04 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:24:04 devstack sudo[92073]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1.de28a842-f76f-4ad1-950a-f1a34c08fcd0" returned: 0 in 0.699s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1.de28a842-f76f-4ad1-950a-f1a34c08fcd0 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:04 devstack sudo[92079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1.de28a842-f76f-4ad1-950a-f1a34c08fcd0 Apr 28 19:24:04 devstack sudo[92079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:04 devstack sudo[92079]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1.de28a842-f76f-4ad1-950a-f1a34c08fcd0" returned: 0 in 0.604s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:04 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Lock "cinder-quobyte-de28a842-f76f-4ad1-950a-f1a34c08fcd0" released by "_delete_snapshot" :: held 2.860s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:24:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.395s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:24:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-51062a32-91b9-49d4-acb4-81e18cda8ba3 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.073s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:24:04 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-51062a32-91b9-49d4-acb4-81e18cda8ba3 tempest-VolumesSnapshotTestJSON-389413737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-516815961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20b63c40-b40a-41dc-8425-e733c9f01358,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcd7eac94c09403f92b066b388f6d053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:23:56Z,use_quota=True,user_id='57349484d0c543c39251044039afccea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:24:04 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-51062a32-91b9-49d4-acb4-81e18cda8ba3 tempest-VolumesSnapshotTestJSON-389413737 None] Creating volume 20b63c40-b40a-41dc-8425-e733c9f01358 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:24:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-51062a32-91b9-49d4-acb4-81e18cda8ba3 tempest-VolumesSnapshotTestJSON-389413737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:24:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-51062a32-91b9-49d4-acb4-81e18cda8ba3 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:24:04 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-51062a32-91b9-49d4-acb4-81e18cda8ba3 tempest-VolumesSnapshotTestJSON-389413737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:24:04 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-51062a32-91b9-49d4-acb4-81e18cda8ba3 tempest-VolumesSnapshotTestJSON-389413737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:24:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-51062a32-91b9-49d4-acb4-81e18cda8ba3 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:24:04 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-51062a32-91b9-49d4-acb4-81e18cda8ba3 tempest-VolumesSnapshotTestJSON-389413737 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:24:04 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-51062a32-91b9-49d4-acb4-81e18cda8ba3 tempest-VolumesSnapshotTestJSON-389413737 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:24:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-51062a32-91b9-49d4-acb4-81e18cda8ba3 tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1959c1b0-b393-4849-ac9a-07567826f3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-016f2202-6c90-4049-9982-e91567dc92b2', 'volume_size': 1, 'source_volid': '9d509770-94ed-4304-bdf8-b17eb0e3a2c1', 'source_volstatus': 'available'}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:24:04 devstack sudo[92082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358 1073741824 Apr 28 19:24:04 devstack sudo[92082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (086dd441-34af-44fb-8401-ee7f0ded5650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:04 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Volume volume-016f2202-6c90-4049-9982-e91567dc92b2 (016f2202-6c90-4049-9982-e91567dc92b2): created successfully Apr 28 19:24:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (086dd441-34af-44fb-8401-ee7f0ded5650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:24:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Flow 'volume_create_manager' (43e7a98e-e295-495c-90ab-5ff19c0ba101) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:24:04 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-1a8feb7e-1e90-4017-9fe2-061e513ad0ef tempest-VolumeDependencyTests-448203194 None] Created volume successfully. Apr 28 19:24:05 devstack sudo[92082]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-51062a32-91b9-49d4-acb4-81e18cda8ba3 tempest-VolumesSnapshotTestJSON-389413737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358 1073741824" returned: 0 in 0.775s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-51062a32-91b9-49d4-acb4-81e18cda8ba3 tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:05 devstack sudo[92087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358 Apr 28 19:24:05 devstack sudo[92087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:05 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a2b33b68-f25a-4ae3-b111-ab42652635e0 tempest-VolumeDependencyTests-448203194 None] Acquiring lock "cinder-9d509770-94ed-4304-bdf8-b17eb0e3a2c1-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:24:05 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a2b33b68-f25a-4ae3-b111-ab42652635e0 tempest-VolumeDependencyTests-448203194 None] Lock "cinder-9d509770-94ed-4304-bdf8-b17eb0e3a2c1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:24:05 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a2b33b68-f25a-4ae3-b111-ab42652635e0 tempest-VolumeDependencyTests-448203194 None] Acquiring lock "cinder-quobyte-9d509770-94ed-4304-bdf8-b17eb0e3a2c1" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:24:05 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a2b33b68-f25a-4ae3-b111-ab42652635e0 tempest-VolumeDependencyTests-448203194 None] Lock "cinder-quobyte-9d509770-94ed-4304-bdf8-b17eb0e3a2c1" acquired by "delete_volume" :: waited 0.015s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:24:05 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[12876eda-d15e-43a4-8156-840a92d5f2de]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:24:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a2b33b68-f25a-4ae3-b111-ab42652635e0 tempest-VolumeDependencyTests-448203194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:06 devstack sudo[92089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1 Apr 28 19:24:06 devstack sudo[92089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:06 devstack sudo[92087]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-51062a32-91b9-49d4-acb4-81e18cda8ba3 tempest-VolumesSnapshotTestJSON-389413737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358" returned: 0 in 0.623s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:06 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-51062a32-91b9-49d4-acb4-81e18cda8ba3 tempest-VolumesSnapshotTestJSON-389413737 None] <== create_volume: return (1435ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:24:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-51062a32-91b9-49d4-acb4-81e18cda8ba3 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.438s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:24:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-41ef0146-74f3-4efb-bbe7-b1b1a9b111f9 tempest-VolumesSnapshotListTestJSON-1261208981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.122s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:24:06 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-41ef0146-74f3-4efb-bbe7-b1b1a9b111f9 tempest-VolumesSnapshotListTestJSON-1261208981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-728133882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95dcbb59-8600-48a6-84a5-3be97022c9e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41f3ffbb83d1410a8c53ec19487c6f5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:24:01Z,use_quota=True,user_id='b091830fa08c4b25973b7c5fd7e8170f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:24:06 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-41ef0146-74f3-4efb-bbe7-b1b1a9b111f9 tempest-VolumesSnapshotListTestJSON-1261208981 None] Creating volume 95dcbb59-8600-48a6-84a5-3be97022c9e7 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:24:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-41ef0146-74f3-4efb-bbe7-b1b1a9b111f9 tempest-VolumesSnapshotListTestJSON-1261208981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:24:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-41ef0146-74f3-4efb-bbe7-b1b1a9b111f9 tempest-VolumesSnapshotListTestJSON-1261208981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:24:06 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-41ef0146-74f3-4efb-bbe7-b1b1a9b111f9 tempest-VolumesSnapshotListTestJSON-1261208981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:24:06 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-41ef0146-74f3-4efb-bbe7-b1b1a9b111f9 tempest-VolumesSnapshotListTestJSON-1261208981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:24:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-41ef0146-74f3-4efb-bbe7-b1b1a9b111f9 tempest-VolumesSnapshotListTestJSON-1261208981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:24:06 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-41ef0146-74f3-4efb-bbe7-b1b1a9b111f9 tempest-VolumesSnapshotListTestJSON-1261208981 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:24:06 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-41ef0146-74f3-4efb-bbe7-b1b1a9b111f9 tempest-VolumesSnapshotListTestJSON-1261208981 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:24:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-41ef0146-74f3-4efb-bbe7-b1b1a9b111f9 tempest-VolumesSnapshotListTestJSON-1261208981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-51062a32-91b9-49d4-acb4-81e18cda8ba3 tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (436446d0-1026-48f5-8a96-1c5b4b9a5e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20b63c40-b40a-41dc-8425-e733c9f01358', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:24:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-51062a32-91b9-49d4-acb4-81e18cda8ba3 tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d576be9a-3829-4d1a-a0b5-7f88775810cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:06 devstack sudo[92092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7 1073741824 Apr 28 19:24:06 devstack sudo[92092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:06 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-51062a32-91b9-49d4-acb4-81e18cda8ba3 tempest-VolumesSnapshotTestJSON-389413737 None] Volume volume-20b63c40-b40a-41dc-8425-e733c9f01358 (20b63c40-b40a-41dc-8425-e733c9f01358): created successfully Apr 28 19:24:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-51062a32-91b9-49d4-acb4-81e18cda8ba3 tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d576be9a-3829-4d1a-a0b5-7f88775810cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:24:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-51062a32-91b9-49d4-acb4-81e18cda8ba3 tempest-VolumesSnapshotTestJSON-389413737 None] Flow 'volume_create_manager' (df5ae9d2-4ff2-45a7-893b-4ef9862798ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:24:06 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-51062a32-91b9-49d4-acb4-81e18cda8ba3 tempest-VolumesSnapshotTestJSON-389413737 None] Created volume successfully. Apr 28 19:24:06 devstack sudo[92089]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a2b33b68-f25a-4ae3-b111-ab42652635e0 tempest-VolumeDependencyTests-448203194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1" returned: 0 in 0.742s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a2b33b68-f25a-4ae3-b111-ab42652635e0 tempest-VolumeDependencyTests-448203194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:06 devstack sudo[92097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1 Apr 28 19:24:06 devstack sudo[92097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:07 devstack sudo[92092]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-41ef0146-74f3-4efb-bbe7-b1b1a9b111f9 tempest-VolumesSnapshotListTestJSON-1261208981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7 1073741824" returned: 0 in 0.809s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-41ef0146-74f3-4efb-bbe7-b1b1a9b111f9 tempest-VolumesSnapshotListTestJSON-1261208981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:07 devstack sudo[92102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7 Apr 28 19:24:07 devstack sudo[92102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a2b33b68-f25a-4ae3-b111-ab42652635e0 tempest-VolumeDependencyTests-448203194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9d509770-94ed-4304-bdf8-b17eb0e3a2c1" returned: 0 in 0.656s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:07 devstack sudo[92097]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:07 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a2b33b68-f25a-4ae3-b111-ab42652635e0 tempest-VolumeDependencyTests-448203194 None] Lock "cinder-quobyte-9d509770-94ed-4304-bdf8-b17eb0e3a2c1" released by "delete_volume" :: held 1.471s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:24:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c08bfc2e-2ce1-41ce-afd1-d6be21b62c8f tempest-VolumesSnapshotTestJSON-389413737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:24:07 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-a2b33b68-f25a-4ae3-b111-ab42652635e0 tempest-VolumeDependencyTests-448203194 None] Created reservations ['5395aea7-6995-4a7d-b87f-74627ccca6df', '9371a8ef-462b-49c1-b62e-636ecd9ecb5c', '68bb2d33-5f8a-4a91-85d4-5729cdd883c3', 'eea13e6a-df5b-41af-a2d7-3404478fe74e'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:24:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a2b33b68-f25a-4ae3-b111-ab42652635e0 tempest-VolumeDependencyTests-448203194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:24:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a2b33b68-f25a-4ae3-b111-ab42652635e0 tempest-VolumeDependencyTests-448203194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:24:07 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a2b33b68-f25a-4ae3-b111-ab42652635e0 tempest-VolumeDependencyTests-448203194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:24:07 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a2b33b68-f25a-4ae3-b111-ab42652635e0 tempest-VolumeDependencyTests-448203194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:24:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a2b33b68-f25a-4ae3-b111-ab42652635e0 tempest-VolumeDependencyTests-448203194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:24:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a2b33b68-f25a-4ae3-b111-ab42652635e0 tempest-VolumeDependencyTests-448203194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:07 devstack sudo[92105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:24:07 devstack sudo[92105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:07 devstack sudo[92102]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-41ef0146-74f3-4efb-bbe7-b1b1a9b111f9 tempest-VolumesSnapshotListTestJSON-1261208981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7" returned: 0 in 0.629s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:07 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-41ef0146-74f3-4efb-bbe7-b1b1a9b111f9 tempest-VolumesSnapshotListTestJSON-1261208981 None] <== create_volume: return (1495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:24:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-41ef0146-74f3-4efb-bbe7-b1b1a9b111f9 tempest-VolumesSnapshotListTestJSON-1261208981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.501s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:24:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c08bfc2e-2ce1-41ce-afd1-d6be21b62c8f tempest-VolumesSnapshotTestJSON-389413737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.345s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:24:07 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-41ef0146-74f3-4efb-bbe7-b1b1a9b111f9 tempest-VolumesSnapshotListTestJSON-1261208981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0475e179-ec99-4152-b4fc-c74efa5950fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95dcbb59-8600-48a6-84a5-3be97022c9e7', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:24:07 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-41ef0146-74f3-4efb-bbe7-b1b1a9b111f9 tempest-VolumesSnapshotListTestJSON-1261208981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (093a2c8c-6b5f-4783-b0b7-4e2987d9dba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:07 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-c08bfc2e-2ce1-41ce-afd1-d6be21b62c8f tempest-VolumesSnapshotTestJSON-389413737 None] Creating offline snapshot 9fb599af-031a-4ff4-9f87-a0616b8375dc of volume 20b63c40-b40a-41dc-8425-e733c9f01358 {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 19:24:07 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-41ef0146-74f3-4efb-bbe7-b1b1a9b111f9 tempest-VolumesSnapshotListTestJSON-1261208981 None] Volume volume-95dcbb59-8600-48a6-84a5-3be97022c9e7 (95dcbb59-8600-48a6-84a5-3be97022c9e7): created successfully Apr 28 19:24:07 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-41ef0146-74f3-4efb-bbe7-b1b1a9b111f9 tempest-VolumesSnapshotListTestJSON-1261208981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (093a2c8c-6b5f-4783-b0b7-4e2987d9dba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:24:07 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-41ef0146-74f3-4efb-bbe7-b1b1a9b111f9 tempest-VolumesSnapshotListTestJSON-1261208981 None] Flow 'volume_create_manager' (7a315fef-a906-4567-8973-6fbeeba909f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:24:07 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c923739-370f-4baa-af86-685a97b3086b]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:24:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c08bfc2e-2ce1-41ce-afd1-d6be21b62c8f tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:07 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-41ef0146-74f3-4efb-bbe7-b1b1a9b111f9 tempest-VolumesSnapshotListTestJSON-1261208981 None] Created volume successfully. Apr 28 19:24:07 devstack sudo[92108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358 Apr 28 19:24:07 devstack sudo[92108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:08 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8b8220bf-39eb-4973-b13b-e51390db143d tempest-VolumeDependencyTests-448203194 None] Acquiring lock "cinder-016f2202-6c90-4049-9982-e91567dc92b2-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:24:08 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8b8220bf-39eb-4973-b13b-e51390db143d tempest-VolumeDependencyTests-448203194 None] Lock "cinder-016f2202-6c90-4049-9982-e91567dc92b2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:24:08 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8b8220bf-39eb-4973-b13b-e51390db143d tempest-VolumeDependencyTests-448203194 None] Acquiring lock "cinder-quobyte-016f2202-6c90-4049-9982-e91567dc92b2" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:24:08 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8b8220bf-39eb-4973-b13b-e51390db143d tempest-VolumeDependencyTests-448203194 None] Lock "cinder-quobyte-016f2202-6c90-4049-9982-e91567dc92b2" acquired by "delete_volume" :: waited 0.017s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:24:08 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4b1cd2-637e-43e2-90fe-42353789fd9d]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:24:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8b8220bf-39eb-4973-b13b-e51390db143d tempest-VolumeDependencyTests-448203194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-016f2202-6c90-4049-9982-e91567dc92b2 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:08 devstack sudo[92105]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a2b33b68-f25a-4ae3-b111-ab42652635e0 tempest-VolumeDependencyTests-448203194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.678s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:08 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-a2b33b68-f25a-4ae3-b111-ab42652635e0 tempest-VolumeDependencyTests-448203194 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:24:08 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-a2b33b68-f25a-4ae3-b111-ab42652635e0 tempest-VolumeDependencyTests-448203194 None] Deleted volume successfully. Apr 28 19:24:08 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a2b33b68-f25a-4ae3-b111-ab42652635e0 tempest-VolumeDependencyTests-448203194 None] Lock "cinder-9d509770-94ed-4304-bdf8-b17eb0e3a2c1-delete_volume" released by "delete_volume" :: held 2.382s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:24:08 devstack sudo[92111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-016f2202-6c90-4049-9982-e91567dc92b2 Apr 28 19:24:08 devstack sudo[92111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:08 devstack sudo[92108]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c08bfc2e-2ce1-41ce-afd1-d6be21b62c8f tempest-VolumesSnapshotTestJSON-389413737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358" returned: 0 in 0.800s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c08bfc2e-2ce1-41ce-afd1-d6be21b62c8f tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358.9fb599af-031a-4ff4-9f87-a0616b8375dc 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:08 devstack sudo[92116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358.9fb599af-031a-4ff4-9f87-a0616b8375dc 1G Apr 28 19:24:08 devstack sudo[92116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a1f01f01-ecf3-4aa6-a097-86dc85fdc6a9 tempest-VolumesSnapshotListTestJSON-1261208981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:24:08 devstack sudo[92111]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8b8220bf-39eb-4973-b13b-e51390db143d tempest-VolumeDependencyTests-448203194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-016f2202-6c90-4049-9982-e91567dc92b2" returned: 0 in 0.783s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8b8220bf-39eb-4973-b13b-e51390db143d tempest-VolumeDependencyTests-448203194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-016f2202-6c90-4049-9982-e91567dc92b2 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:09 devstack sudo[92121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-016f2202-6c90-4049-9982-e91567dc92b2 Apr 28 19:24:09 devstack sudo[92121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:09 devstack sudo[92116]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c08bfc2e-2ce1-41ce-afd1-d6be21b62c8f tempest-VolumesSnapshotTestJSON-389413737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358.9fb599af-031a-4ff4-9f87-a0616b8375dc 1G" returned: 0 in 0.814s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c08bfc2e-2ce1-41ce-afd1-d6be21b62c8f tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20b63c40-b40a-41dc-8425-e733c9f01358 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358.9fb599af-031a-4ff4-9f87-a0616b8375dc {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:09 devstack sudo[92126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20b63c40-b40a-41dc-8425-e733c9f01358 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358.9fb599af-031a-4ff4-9f87-a0616b8375dc Apr 28 19:24:09 devstack sudo[92126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:09 devstack sudo[92121]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8b8220bf-39eb-4973-b13b-e51390db143d tempest-VolumeDependencyTests-448203194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-016f2202-6c90-4049-9982-e91567dc92b2" returned: 0 in 0.639s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:09 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8b8220bf-39eb-4973-b13b-e51390db143d tempest-VolumeDependencyTests-448203194 None] Lock "cinder-quobyte-016f2202-6c90-4049-9982-e91567dc92b2" released by "delete_volume" :: held 1.481s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:24:09 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-8b8220bf-39eb-4973-b13b-e51390db143d tempest-VolumeDependencyTests-448203194 None] Created reservations ['a233102b-726b-41d5-9a2a-60e988a245e7', '7a97aa41-c0d9-4adb-bd28-07ad84c46254', 'd6b825cc-9b39-49fd-9e32-a9b9eaa4c59e', 'e0fb4a16-30c2-4ba1-beb2-830f61a4726e'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:24:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8b8220bf-39eb-4973-b13b-e51390db143d tempest-VolumeDependencyTests-448203194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:24:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8b8220bf-39eb-4973-b13b-e51390db143d tempest-VolumeDependencyTests-448203194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:24:09 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-8b8220bf-39eb-4973-b13b-e51390db143d tempest-VolumeDependencyTests-448203194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:24:09 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-8b8220bf-39eb-4973-b13b-e51390db143d tempest-VolumeDependencyTests-448203194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:24:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8b8220bf-39eb-4973-b13b-e51390db143d tempest-VolumeDependencyTests-448203194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:24:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8b8220bf-39eb-4973-b13b-e51390db143d tempest-VolumeDependencyTests-448203194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:09 devstack sudo[92129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:24:09 devstack sudo[92129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:10 devstack sudo[92126]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c08bfc2e-2ce1-41ce-afd1-d6be21b62c8f tempest-VolumesSnapshotTestJSON-389413737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20b63c40-b40a-41dc-8425-e733c9f01358 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358.9fb599af-031a-4ff4-9f87-a0616b8375dc" returned: 0 in 0.661s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:10 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-c08bfc2e-2ce1-41ce-afd1-d6be21b62c8f tempest-VolumesSnapshotTestJSON-389413737 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358.9fb599af-031a-4ff4-9f87-a0616b8375dc is being set with open permissions: ugo+rw Apr 28 19:24:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c08bfc2e-2ce1-41ce-afd1-d6be21b62c8f tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358.9fb599af-031a-4ff4-9f87-a0616b8375dc {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:10 devstack sudo[92134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358.9fb599af-031a-4ff4-9f87-a0616b8375dc Apr 28 19:24:10 devstack sudo[92134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:10 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2fa8d3f5-d464-4a58-83e0-a91206875486 tempest-VolumeDependencyTests-448203194 None] Acquiring lock "cinder-521ded01-d778-486f-88ec-41c2ed498db9-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:24:10 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2fa8d3f5-d464-4a58-83e0-a91206875486 tempest-VolumeDependencyTests-448203194 None] Lock "cinder-521ded01-d778-486f-88ec-41c2ed498db9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:24:10 devstack sudo[92129]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8b8220bf-39eb-4973-b13b-e51390db143d tempest-VolumeDependencyTests-448203194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.617s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:10 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-8b8220bf-39eb-4973-b13b-e51390db143d tempest-VolumeDependencyTests-448203194 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:24:10 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-8b8220bf-39eb-4973-b13b-e51390db143d tempest-VolumeDependencyTests-448203194 None] Deleted volume successfully. Apr 28 19:24:10 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8b8220bf-39eb-4973-b13b-e51390db143d tempest-VolumeDependencyTests-448203194 None] Lock "cinder-016f2202-6c90-4049-9982-e91567dc92b2-delete_volume" released by "delete_volume" :: held 2.338s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:24:10 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2fa8d3f5-d464-4a58-83e0-a91206875486 tempest-VolumeDependencyTests-448203194 None] Acquiring lock "cinder-quobyte-521ded01-d778-486f-88ec-41c2ed498db9" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:24:10 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2fa8d3f5-d464-4a58-83e0-a91206875486 tempest-VolumeDependencyTests-448203194 None] Lock "cinder-quobyte-521ded01-d778-486f-88ec-41c2ed498db9" acquired by "delete_volume" :: waited 0.014s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:24:10 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c209992-83b2-4b7e-a83a-7e6fb7494a0e]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:24:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2fa8d3f5-d464-4a58-83e0-a91206875486 tempest-VolumeDependencyTests-448203194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-521ded01-d778-486f-88ec-41c2ed498db9 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:10 devstack sudo[92137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-521ded01-d778-486f-88ec-41c2ed498db9 Apr 28 19:24:10 devstack sudo[92137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:10 devstack sudo[92134]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c08bfc2e-2ce1-41ce-afd1-d6be21b62c8f tempest-VolumesSnapshotTestJSON-389413737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358.9fb599af-031a-4ff4-9f87-a0616b8375dc" returned: 0 in 0.620s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c08bfc2e-2ce1-41ce-afd1-d6be21b62c8f tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:10 devstack sudo[92141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358.info Apr 28 19:24:10 devstack sudo[92141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:11 devstack sudo[92137]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2fa8d3f5-d464-4a58-83e0-a91206875486 tempest-VolumeDependencyTests-448203194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-521ded01-d778-486f-88ec-41c2ed498db9" returned: 0 in 0.719s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2fa8d3f5-d464-4a58-83e0-a91206875486 tempest-VolumeDependencyTests-448203194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-521ded01-d778-486f-88ec-41c2ed498db9 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:11 devstack sudo[92146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-521ded01-d778-486f-88ec-41c2ed498db9 Apr 28 19:24:11 devstack sudo[92146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:11 devstack sudo[92141]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c08bfc2e-2ce1-41ce-afd1-d6be21b62c8f tempest-VolumesSnapshotTestJSON-389413737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358.info" returned: 0 in 0.599s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:11 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-c08bfc2e-2ce1-41ce-afd1-d6be21b62c8f tempest-VolumesSnapshotTestJSON-389413737 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358.info is being set with open permissions: ugo+rw Apr 28 19:24:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c08bfc2e-2ce1-41ce-afd1-d6be21b62c8f tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:11 devstack sudo[92149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358.info Apr 28 19:24:11 devstack sudo[92149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:11 devstack sudo[92146]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2fa8d3f5-d464-4a58-83e0-a91206875486 tempest-VolumeDependencyTests-448203194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-521ded01-d778-486f-88ec-41c2ed498db9" returned: 0 in 0.621s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:11 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2fa8d3f5-d464-4a58-83e0-a91206875486 tempest-VolumeDependencyTests-448203194 None] Lock "cinder-quobyte-521ded01-d778-486f-88ec-41c2ed498db9" released by "delete_volume" :: held 1.378s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:24:11 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-2fa8d3f5-d464-4a58-83e0-a91206875486 tempest-VolumeDependencyTests-448203194 None] Created reservations ['e6d262b9-b133-43e8-9b2f-2617abe4896e', '74dc1a1b-ab6c-46ac-a2a9-8f83b01a1284', '7327f718-2bde-4c8c-b748-b732e15463fa', 'cd142b97-7557-42db-88ee-08e808f9497b'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:24:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2fa8d3f5-d464-4a58-83e0-a91206875486 tempest-VolumeDependencyTests-448203194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:24:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2fa8d3f5-d464-4a58-83e0-a91206875486 tempest-VolumeDependencyTests-448203194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:24:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2fa8d3f5-d464-4a58-83e0-a91206875486 tempest-VolumeDependencyTests-448203194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:24:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2fa8d3f5-d464-4a58-83e0-a91206875486 tempest-VolumeDependencyTests-448203194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:24:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2fa8d3f5-d464-4a58-83e0-a91206875486 tempest-VolumeDependencyTests-448203194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:24:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2fa8d3f5-d464-4a58-83e0-a91206875486 tempest-VolumeDependencyTests-448203194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:11 devstack sudo[92153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:24:11 devstack sudo[92153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:12 devstack sudo[92149]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c08bfc2e-2ce1-41ce-afd1-d6be21b62c8f tempest-VolumesSnapshotTestJSON-389413737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358.info" returned: 0 in 0.643s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c08bfc2e-2ce1-41ce-afd1-d6be21b62c8f tempest-VolumesSnapshotTestJSON-389413737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.267s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:24:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a1f01f01-ecf3-4aa6-a097-86dc85fdc6a9 tempest-VolumesSnapshotListTestJSON-1261208981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.296s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:24:12 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-a1f01f01-ecf3-4aa6-a097-86dc85fdc6a9 tempest-VolumesSnapshotListTestJSON-1261208981 None] Creating offline snapshot 4515f431-cf23-42e5-adc3-d91d8c135f4a of volume 95dcbb59-8600-48a6-84a5-3be97022c9e7 {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 19:24:12 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a5b0ee-9a95-455a-8e44-5469fff70660]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:24:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a1f01f01-ecf3-4aa6-a097-86dc85fdc6a9 tempest-VolumesSnapshotListTestJSON-1261208981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:12 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-c08bfc2e-2ce1-41ce-afd1-d6be21b62c8f tempest-VolumesSnapshotTestJSON-389413737 None] Create snapshot completed successfully Apr 28 19:24:12 devstack sudo[92155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7 Apr 28 19:24:12 devstack sudo[92155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:12 devstack sudo[92153]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2fa8d3f5-d464-4a58-83e0-a91206875486 tempest-VolumeDependencyTests-448203194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.639s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:12 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-2fa8d3f5-d464-4a58-83e0-a91206875486 tempest-VolumeDependencyTests-448203194 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:24:12 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-2fa8d3f5-d464-4a58-83e0-a91206875486 tempest-VolumeDependencyTests-448203194 None] Deleted volume successfully. Apr 28 19:24:12 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2fa8d3f5-d464-4a58-83e0-a91206875486 tempest-VolumeDependencyTests-448203194 None] Lock "cinder-521ded01-d778-486f-88ec-41c2ed498db9-delete_volume" released by "delete_volume" :: held 2.248s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:24:12 devstack sudo[92155]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a1f01f01-ecf3-4aa6-a097-86dc85fdc6a9 tempest-VolumesSnapshotListTestJSON-1261208981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7" returned: 0 in 0.777s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a1f01f01-ecf3-4aa6-a097-86dc85fdc6a9 tempest-VolumesSnapshotListTestJSON-1261208981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.4515f431-cf23-42e5-adc3-d91d8c135f4a 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:12 devstack sudo[92161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.4515f431-cf23-42e5-adc3-d91d8c135f4a 1G Apr 28 19:24:12 devstack sudo[92161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:13 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:24:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] Flow 'volume_create_manager' (3601f002-4bd2-4943-b4be-ed5070a50c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:24:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54befa52-2b60-4b95-ad98-1413b9f56fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54befa52-2b60-4b95-ad98-1413b9f56fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2007162817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3f1652d-ba02-4091-abc0-0ca622f6a486,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcd7eac94c09403f92b066b388f6d053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9fb599af-031a-4ff4-9f87-a0616b8375dc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:24:13Z,use_quota=True,user_id='57349484d0c543c39251044039afccea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:24:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87cbef57-376f-4e1e-9810-c64647f79e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87cbef57-376f-4e1e-9810-c64647f79e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:24:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67b05378-c6e5-4164-99b7-ee7e4f3ce49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67b05378-c6e5-4164-99b7-ee7e4f3ce49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f3f1652d-ba02-4091-abc0-0ca622f6a486', 'volume_name': 'volume-f3f1652d-ba02-4091-abc0-0ca622f6a486', 'volume_size': 1, 'snapshot_id': '9fb599af-031a-4ff4-9f87-a0616b8375dc'}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:24:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62aa8a39-3a92-47a6-9216-fd7568fe5273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62aa8a39-3a92-47a6-9216-fd7568fe5273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:24:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (539df35f-0d0e-4d70-9a8c-049cd8035ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:13 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] Volume f3f1652d-ba02-4091-abc0-0ca622f6a486: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f3f1652d-ba02-4091-abc0-0ca622f6a486', 'volume_size': 1, 'snapshot_id': '9fb599af-031a-4ff4-9f87-a0616b8375dc'} Apr 28 19:24:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:24:13 devstack sudo[92161]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a1f01f01-ecf3-4aa6-a097-86dc85fdc6a9 tempest-VolumesSnapshotListTestJSON-1261208981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.4515f431-cf23-42e5-adc3-d91d8c135f4a 1G" returned: 0 in 0.866s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a1f01f01-ecf3-4aa6-a097-86dc85fdc6a9 tempest-VolumesSnapshotListTestJSON-1261208981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95dcbb59-8600-48a6-84a5-3be97022c9e7 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.4515f431-cf23-42e5-adc3-d91d8c135f4a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:13 devstack sudo[92168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95dcbb59-8600-48a6-84a5-3be97022c9e7 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.4515f431-cf23-42e5-adc3-d91d8c135f4a Apr 28 19:24:13 devstack sudo[92168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:14 devstack sudo[92168]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a1f01f01-ecf3-4aa6-a097-86dc85fdc6a9 tempest-VolumesSnapshotListTestJSON-1261208981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95dcbb59-8600-48a6-84a5-3be97022c9e7 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.4515f431-cf23-42e5-adc3-d91d8c135f4a" returned: 0 in 0.724s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:14 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-a1f01f01-ecf3-4aa6-a097-86dc85fdc6a9 tempest-VolumesSnapshotListTestJSON-1261208981 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.4515f431-cf23-42e5-adc3-d91d8c135f4a is being set with open permissions: ugo+rw Apr 28 19:24:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a1f01f01-ecf3-4aa6-a097-86dc85fdc6a9 tempest-VolumesSnapshotListTestJSON-1261208981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.4515f431-cf23-42e5-adc3-d91d8c135f4a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:14 devstack sudo[92173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.4515f431-cf23-42e5-adc3-d91d8c135f4a Apr 28 19:24:14 devstack sudo[92173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:15 devstack sudo[92173]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a1f01f01-ecf3-4aa6-a097-86dc85fdc6a9 tempest-VolumesSnapshotListTestJSON-1261208981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.4515f431-cf23-42e5-adc3-d91d8c135f4a" returned: 0 in 0.610s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a1f01f01-ecf3-4aa6-a097-86dc85fdc6a9 tempest-VolumesSnapshotListTestJSON-1261208981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:15 devstack sudo[92176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.info Apr 28 19:24:15 devstack sudo[92176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:15 devstack sudo[92176]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a1f01f01-ecf3-4aa6-a097-86dc85fdc6a9 tempest-VolumesSnapshotListTestJSON-1261208981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.info" returned: 0 in 0.589s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:15 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-a1f01f01-ecf3-4aa6-a097-86dc85fdc6a9 tempest-VolumesSnapshotListTestJSON-1261208981 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.info is being set with open permissions: ugo+rw Apr 28 19:24:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a1f01f01-ecf3-4aa6-a097-86dc85fdc6a9 tempest-VolumesSnapshotListTestJSON-1261208981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:15 devstack sudo[92179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.info Apr 28 19:24:15 devstack sudo[92179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:16 devstack sudo[92179]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a1f01f01-ecf3-4aa6-a097-86dc85fdc6a9 tempest-VolumesSnapshotListTestJSON-1261208981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.info" returned: 0 in 0.593s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a1f01f01-ecf3-4aa6-a097-86dc85fdc6a9 tempest-VolumesSnapshotListTestJSON-1261208981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.255s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:24:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.004s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:24:16 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] Acquiring lock "cinder-quobyte-9fb599af-031a-4ff4-9f87-a0616b8375dc-f3f1652d-ba02-4091-abc0-0ca622f6a486" by "_create_volume_from_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:24:16 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] Lock "cinder-quobyte-9fb599af-031a-4ff4-9f87-a0616b8375dc-f3f1652d-ba02-4091-abc0-0ca622f6a486" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:24:16 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] Creating volume f3f1652d-ba02-4091-abc0-0ca622f6a486 from snapshot 9fb599af-031a-4ff4-9f87-a0616b8375dc {{(pid=83863) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 28 19:24:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:24:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:24:16 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:24:16 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:24:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:24:16 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:24:16 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] Acquiring lock "cinder-quobyte-f3f1652d-ba02-4091-abc0-0ca622f6a486" by "_copy_volume_from_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:24:16 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-a1f01f01-ecf3-4aa6-a097-86dc85fdc6a9 tempest-VolumesSnapshotListTestJSON-1261208981 None] Create snapshot completed successfully Apr 28 19:24:16 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] Lock "cinder-quobyte-f3f1652d-ba02-4091-abc0-0ca622f6a486" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:24:16 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] snapshot: 9fb599af-031a-4ff4-9f87-a0616b8375dc, volume: f3f1652d-ba02-4091-abc0-0ca622f6a486, {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 19:24:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:24:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:24:16 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:24:16 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:24:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:24:16 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9763b3-89a7-4b81-bc73-f33242aae264]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:24:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358.9fb599af-031a-4ff4-9f87-a0616b8375dc {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:16 devstack sudo[92182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358.9fb599af-031a-4ff4-9f87-a0616b8375dc Apr 28 19:24:16 devstack sudo[92182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:17 devstack sudo[92182]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358.9fb599af-031a-4ff4-9f87-a0616b8375dc" returned: 0 in 0.709s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20b63c40-b40a-41dc-8425-e733c9f01358(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:24:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358 {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 19:24:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] Creating direct copy from snapshot {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 19:24:17 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee74cd8-2c47-49c8-a1fb-f796c1603de6]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:24:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-99a30951-3c0e-4640-8415-310363fc7976 tempest-VolumesSnapshotListTestJSON-1261208981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:24:17 devstack sudo[92187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358 Apr 28 19:24:17 devstack sudo[92187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:17 devstack sudo[92187]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358" returned: 0 in 0.721s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:17 devstack cinder-volume[83863]: DEBUG cinder.utils [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] Path /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f3f1652d-ba02-4091-abc0-0ca622f6a486 not found in is_blk_device check {{(pid=83863) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 19:24:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f3f1652d-ba02-4091-abc0-0ca622f6a486 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:17 devstack sudo[92192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f3f1652d-ba02-4091-abc0-0ca622f6a486 Apr 28 19:24:17 devstack sudo[92192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:22 devstack sudo[92192]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f3f1652d-ba02-4091-abc0-0ca622f6a486" returned: 0 in 4.549s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:22 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a519b3db-a429-4be4-b7d6-2e65a5114d33]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:24:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:22 devstack sudo[92206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358 Apr 28 19:24:22 devstack sudo[92206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:23 devstack sudo[92206]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358" returned: 0 in 0.858s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:23 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] Image conversion details: src /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358, size 1024.00 MB, duration 4.55 sec, destination /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f3f1652d-ba02-4091-abc0-0ca622f6a486 {{(pid=83863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 19:24:23 devstack cinder-volume[83863]: INFO cinder.image.image_utils [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] Converted 1024.00 MB image at 225.02 MB/s Apr 28 19:24:23 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f3f1652d-ba02-4091-abc0-0ca622f6a486 is being set with open permissions: ugo+rw Apr 28 19:24:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f3f1652d-ba02-4091-abc0-0ca622f6a486 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:23 devstack sudo[92211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f3f1652d-ba02-4091-abc0-0ca622f6a486 Apr 28 19:24:23 devstack sudo[92211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:23 devstack sudo[92211]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f3f1652d-ba02-4091-abc0-0ca622f6a486" returned: 0 in 0.586s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:23 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] Lock "cinder-quobyte-f3f1652d-ba02-4091-abc0-0ca622f6a486" released by "_copy_volume_from_snapshot" :: held 7.522s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:24:23 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] Lock "cinder-quobyte-9fb599af-031a-4ff4-9f87-a0616b8375dc-f3f1652d-ba02-4091-abc0-0ca622f6a486" released by "_create_volume_from_snapshot" :: held 7.554s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:24:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.578s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:24:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-99a30951-3c0e-4640-8415-310363fc7976 tempest-VolumesSnapshotListTestJSON-1261208981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.649s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:24:23 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-99a30951-3c0e-4640-8415-310363fc7976 tempest-VolumesSnapshotListTestJSON-1261208981 None] Creating offline snapshot 372ca08c-e8fc-444f-bd22-5a4803f90cf8 of volume 95dcbb59-8600-48a6-84a5-3be97022c9e7 {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 19:24:23 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (539df35f-0d0e-4d70-9a8c-049cd8035ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3f1652d-ba02-4091-abc0-0ca622f6a486', 'volume_size': 1, 'snapshot_id': '9fb599af-031a-4ff4-9f87-a0616b8375dc'}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:24:23 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18894f45-f284-408f-9527-86764f2c06b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:23 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67ed726-48ca-4171-b8d5-7b1cd599e38d]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:24:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-99a30951-3c0e-4640-8415-310363fc7976 tempest-VolumesSnapshotListTestJSON-1261208981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.4515f431-cf23-42e5-adc3-d91d8c135f4a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:23 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] Volume volume-f3f1652d-ba02-4091-abc0-0ca622f6a486 (f3f1652d-ba02-4091-abc0-0ca622f6a486): created successfully Apr 28 19:24:23 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18894f45-f284-408f-9527-86764f2c06b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:24:23 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] Flow 'volume_create_manager' (3601f002-4bd2-4943-b4be-ed5070a50c66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:24:24 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-ff1b2f54-9146-4b61-926e-b77712229c5f tempest-VolumesSnapshotTestJSON-389413737 None] Created volume successfully. Apr 28 19:24:24 devstack sudo[92214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.4515f431-cf23-42e5-adc3-d91d8c135f4a Apr 28 19:24:24 devstack sudo[92214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:24 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-92bbb7a9-b16d-4e02-a509-c96e6ad48e90 tempest-VolumesSnapshotTestJSON-389413737 None] Acquiring lock "cinder-f3f1652d-ba02-4091-abc0-0ca622f6a486-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:24:24 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-92bbb7a9-b16d-4e02-a509-c96e6ad48e90 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "cinder-f3f1652d-ba02-4091-abc0-0ca622f6a486-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:24:24 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-92bbb7a9-b16d-4e02-a509-c96e6ad48e90 tempest-VolumesSnapshotTestJSON-389413737 None] Acquiring lock "cinder-quobyte-f3f1652d-ba02-4091-abc0-0ca622f6a486" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:24:24 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-92bbb7a9-b16d-4e02-a509-c96e6ad48e90 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "cinder-quobyte-f3f1652d-ba02-4091-abc0-0ca622f6a486" acquired by "delete_volume" :: waited 0.017s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:24:24 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f36c45-0bbc-4cec-9b87-45772c0309e8]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:24:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-92bbb7a9-b16d-4e02-a509-c96e6ad48e90 tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f3f1652d-ba02-4091-abc0-0ca622f6a486 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:24 devstack sudo[92216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f3f1652d-ba02-4091-abc0-0ca622f6a486 Apr 28 19:24:24 devstack sudo[92216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:24 devstack sudo[92214]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-99a30951-3c0e-4640-8415-310363fc7976 tempest-VolumesSnapshotListTestJSON-1261208981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.4515f431-cf23-42e5-adc3-d91d8c135f4a" returned: 0 in 0.728s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:24 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-99a30951-3c0e-4640-8415-310363fc7976 tempest-VolumesSnapshotListTestJSON-1261208981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95dcbb59-8600-48a6-84a5-3be97022c9e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:24:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-99a30951-3c0e-4640-8415-310363fc7976 tempest-VolumesSnapshotListTestJSON-1261208981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.4515f431-cf23-42e5-adc3-d91d8c135f4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.372ca08c-e8fc-444f-bd22-5a4803f90cf8 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:24 devstack sudo[92221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.4515f431-cf23-42e5-adc3-d91d8c135f4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.372ca08c-e8fc-444f-bd22-5a4803f90cf8 1G Apr 28 19:24:24 devstack sudo[92221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:25 devstack sudo[92216]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-92bbb7a9-b16d-4e02-a509-c96e6ad48e90 tempest-VolumesSnapshotTestJSON-389413737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f3f1652d-ba02-4091-abc0-0ca622f6a486" returned: 0 in 0.751s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-92bbb7a9-b16d-4e02-a509-c96e6ad48e90 tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f3f1652d-ba02-4091-abc0-0ca622f6a486 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:25 devstack sudo[92226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f3f1652d-ba02-4091-abc0-0ca622f6a486 Apr 28 19:24:25 devstack sudo[92226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:25 devstack sudo[92221]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-99a30951-3c0e-4640-8415-310363fc7976 tempest-VolumesSnapshotListTestJSON-1261208981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.4515f431-cf23-42e5-adc3-d91d8c135f4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.372ca08c-e8fc-444f-bd22-5a4803f90cf8 1G" returned: 0 in 0.785s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-99a30951-3c0e-4640-8415-310363fc7976 tempest-VolumesSnapshotListTestJSON-1261208981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.4515f431-cf23-42e5-adc3-d91d8c135f4a -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.372ca08c-e8fc-444f-bd22-5a4803f90cf8 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:25 devstack sudo[92232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.4515f431-cf23-42e5-adc3-d91d8c135f4a -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.372ca08c-e8fc-444f-bd22-5a4803f90cf8 Apr 28 19:24:25 devstack sudo[92232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:25 devstack sudo[92226]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-92bbb7a9-b16d-4e02-a509-c96e6ad48e90 tempest-VolumesSnapshotTestJSON-389413737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f3f1652d-ba02-4091-abc0-0ca622f6a486" returned: 0 in 0.656s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:25 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-92bbb7a9-b16d-4e02-a509-c96e6ad48e90 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "cinder-quobyte-f3f1652d-ba02-4091-abc0-0ca622f6a486" released by "delete_volume" :: held 1.450s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:24:25 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-92bbb7a9-b16d-4e02-a509-c96e6ad48e90 tempest-VolumesSnapshotTestJSON-389413737 None] Created reservations ['50e3f2cd-35a3-48c9-ae22-fe3c1134963e', 'ff023204-773b-4e49-8e5e-277c907ef08b', 'f974052a-7ffc-4e0b-8c69-4ec7c65df275', '71947fa6-0381-4267-a162-ec05c22fddab'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:24:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-92bbb7a9-b16d-4e02-a509-c96e6ad48e90 tempest-VolumesSnapshotTestJSON-389413737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:24:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-92bbb7a9-b16d-4e02-a509-c96e6ad48e90 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:24:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-92bbb7a9-b16d-4e02-a509-c96e6ad48e90 tempest-VolumesSnapshotTestJSON-389413737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:24:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-92bbb7a9-b16d-4e02-a509-c96e6ad48e90 tempest-VolumesSnapshotTestJSON-389413737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:24:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-92bbb7a9-b16d-4e02-a509-c96e6ad48e90 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:24:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-92bbb7a9-b16d-4e02-a509-c96e6ad48e90 tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:25 devstack sudo[92235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:24:25 devstack sudo[92235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:26 devstack sudo[92232]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-99a30951-3c0e-4640-8415-310363fc7976 tempest-VolumesSnapshotListTestJSON-1261208981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.4515f431-cf23-42e5-adc3-d91d8c135f4a -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.372ca08c-e8fc-444f-bd22-5a4803f90cf8" returned: 0 in 0.620s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:26 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-99a30951-3c0e-4640-8415-310363fc7976 tempest-VolumesSnapshotListTestJSON-1261208981 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.372ca08c-e8fc-444f-bd22-5a4803f90cf8 is being set with open permissions: ugo+rw Apr 28 19:24:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-99a30951-3c0e-4640-8415-310363fc7976 tempest-VolumesSnapshotListTestJSON-1261208981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.372ca08c-e8fc-444f-bd22-5a4803f90cf8 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:26 devstack sudo[92240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.372ca08c-e8fc-444f-bd22-5a4803f90cf8 Apr 28 19:24:26 devstack sudo[92240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:26 devstack sudo[92235]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-92bbb7a9-b16d-4e02-a509-c96e6ad48e90 tempest-VolumesSnapshotTestJSON-389413737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.615s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:26 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-92bbb7a9-b16d-4e02-a509-c96e6ad48e90 tempest-VolumesSnapshotTestJSON-389413737 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:24:26 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-92bbb7a9-b16d-4e02-a509-c96e6ad48e90 tempest-VolumesSnapshotTestJSON-389413737 None] Deleted volume successfully. Apr 28 19:24:26 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-92bbb7a9-b16d-4e02-a509-c96e6ad48e90 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "cinder-f3f1652d-ba02-4091-abc0-0ca622f6a486-delete_volume" released by "delete_volume" :: held 2.270s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:24:26 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7af335c0-548a-4dc6-9884-993512f43d98 tempest-VolumesSnapshotTestJSON-389413737 None] Acquiring lock "cinder-9fb599af-031a-4ff4-9f87-a0616b8375dc-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:24:26 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7af335c0-548a-4dc6-9884-993512f43d98 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "cinder-9fb599af-031a-4ff4-9f87-a0616b8375dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:24:26 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7af335c0-548a-4dc6-9884-993512f43d98 tempest-VolumesSnapshotTestJSON-389413737 None] Acquiring lock "cinder-quobyte-20b63c40-b40a-41dc-8425-e733c9f01358" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:24:26 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7af335c0-548a-4dc6-9884-993512f43d98 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "cinder-quobyte-20b63c40-b40a-41dc-8425-e733c9f01358" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:24:26 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7af335c0-548a-4dc6-9884-993512f43d98 tempest-VolumesSnapshotTestJSON-389413737 None] Acquiring lock "cinder-quobyte-9fb599af-031a-4ff4-9f87-a0616b8375dc" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:24:26 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7af335c0-548a-4dc6-9884-993512f43d98 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "cinder-quobyte-9fb599af-031a-4ff4-9f87-a0616b8375dc" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:24:26 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-7af335c0-548a-4dc6-9884-993512f43d98 tempest-VolumesSnapshotTestJSON-389413737 None] Deleting offline snapshot 9fb599af-031a-4ff4-9f87-a0616b8375dc of volume 20b63c40-b40a-41dc-8425-e733c9f01358 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 19:24:26 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-7af335c0-548a-4dc6-9884-993512f43d98 tempest-VolumesSnapshotTestJSON-389413737 None] snapshot_file for this snap is: volume-20b63c40-b40a-41dc-8425-e733c9f01358.9fb599af-031a-4ff4-9f87-a0616b8375dc {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 19:24:26 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5797f789-410f-4e1d-9571-c0486bbbff3f]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:24:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7af335c0-548a-4dc6-9884-993512f43d98 tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358.9fb599af-031a-4ff4-9f87-a0616b8375dc {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:26 devstack sudo[92240]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-99a30951-3c0e-4640-8415-310363fc7976 tempest-VolumesSnapshotListTestJSON-1261208981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.372ca08c-e8fc-444f-bd22-5a4803f90cf8" returned: 0 in 0.617s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-99a30951-3c0e-4640-8415-310363fc7976 tempest-VolumesSnapshotListTestJSON-1261208981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.864s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:24:26 devstack sudo[92244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358.9fb599af-031a-4ff4-9f87-a0616b8375dc Apr 28 19:24:26 devstack sudo[92244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:26 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-99a30951-3c0e-4640-8415-310363fc7976 tempest-VolumesSnapshotListTestJSON-1261208981 None] Create snapshot completed successfully Apr 28 19:24:27 devstack sudo[92244]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7af335c0-548a-4dc6-9884-993512f43d98 tempest-VolumesSnapshotTestJSON-389413737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358.9fb599af-031a-4ff4-9f87-a0616b8375dc" returned: 0 in 0.738s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:27 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-7af335c0-548a-4dc6-9884-993512f43d98 tempest-VolumesSnapshotTestJSON-389413737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20b63c40-b40a-41dc-8425-e733c9f01358(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:24:27 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a451656-9a30-420e-9db9-8781c1012810]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:24:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7af335c0-548a-4dc6-9884-993512f43d98 tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:27 devstack sudo[92249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358 Apr 28 19:24:27 devstack sudo[92249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d02ad989-d640-4af7-b0fa-083aab848d41 tempest-VolumesSnapshotListTestJSON-1261208981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:24:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d02ad989-d640-4af7-b0fa-083aab848d41 tempest-VolumesSnapshotListTestJSON-1261208981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:24:27 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-d02ad989-d640-4af7-b0fa-083aab848d41 tempest-VolumesSnapshotListTestJSON-1261208981 None] Creating offline snapshot 04150c7d-168b-4676-abe5-0c32cd96c0f7 of volume 95dcbb59-8600-48a6-84a5-3be97022c9e7 {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 19:24:27 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff33c4bc-3072-4ed6-9c32-5e777793c292]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:24:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d02ad989-d640-4af7-b0fa-083aab848d41 tempest-VolumesSnapshotListTestJSON-1261208981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.372ca08c-e8fc-444f-bd22-5a4803f90cf8 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:28 devstack sudo[92251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.372ca08c-e8fc-444f-bd22-5a4803f90cf8 Apr 28 19:24:28 devstack sudo[92251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:28 devstack sudo[92249]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7af335c0-548a-4dc6-9884-993512f43d98 tempest-VolumesSnapshotTestJSON-389413737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358" returned: 0 in 0.722s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7af335c0-548a-4dc6-9884-993512f43d98 tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358.9fb599af-031a-4ff4-9f87-a0616b8375dc {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:28 devstack sudo[92256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358.9fb599af-031a-4ff4-9f87-a0616b8375dc Apr 28 19:24:28 devstack sudo[92256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:28 devstack sudo[92251]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d02ad989-d640-4af7-b0fa-083aab848d41 tempest-VolumesSnapshotListTestJSON-1261208981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.372ca08c-e8fc-444f-bd22-5a4803f90cf8" returned: 0 in 0.724s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:28 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-d02ad989-d640-4af7-b0fa-083aab848d41 tempest-VolumesSnapshotListTestJSON-1261208981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95dcbb59-8600-48a6-84a5-3be97022c9e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:24:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d02ad989-d640-4af7-b0fa-083aab848d41 tempest-VolumesSnapshotListTestJSON-1261208981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.372ca08c-e8fc-444f-bd22-5a4803f90cf8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.04150c7d-168b-4676-abe5-0c32cd96c0f7 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:28 devstack sudo[92262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.372ca08c-e8fc-444f-bd22-5a4803f90cf8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.04150c7d-168b-4676-abe5-0c32cd96c0f7 1G Apr 28 19:24:28 devstack sudo[92262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:28 devstack sudo[92256]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7af335c0-548a-4dc6-9884-993512f43d98 tempest-VolumesSnapshotTestJSON-389413737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358.9fb599af-031a-4ff4-9f87-a0616b8375dc" returned: 0 in 0.707s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7af335c0-548a-4dc6-9884-993512f43d98 tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358.9fb599af-031a-4ff4-9f87-a0616b8375dc {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:28 devstack sudo[92266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358.9fb599af-031a-4ff4-9f87-a0616b8375dc Apr 28 19:24:28 devstack sudo[92266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:29 devstack sudo[92262]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d02ad989-d640-4af7-b0fa-083aab848d41 tempest-VolumesSnapshotListTestJSON-1261208981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.372ca08c-e8fc-444f-bd22-5a4803f90cf8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.04150c7d-168b-4676-abe5-0c32cd96c0f7 1G" returned: 0 in 0.826s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d02ad989-d640-4af7-b0fa-083aab848d41 tempest-VolumesSnapshotListTestJSON-1261208981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.372ca08c-e8fc-444f-bd22-5a4803f90cf8 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.04150c7d-168b-4676-abe5-0c32cd96c0f7 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:29 devstack sudo[92273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.372ca08c-e8fc-444f-bd22-5a4803f90cf8 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.04150c7d-168b-4676-abe5-0c32cd96c0f7 Apr 28 19:24:29 devstack sudo[92266]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:29 devstack sudo[92273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7af335c0-548a-4dc6-9884-993512f43d98 tempest-VolumesSnapshotTestJSON-389413737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358.9fb599af-031a-4ff4-9f87-a0616b8375dc" returned: 0 in 0.648s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:29 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7af335c0-548a-4dc6-9884-993512f43d98 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "cinder-quobyte-9fb599af-031a-4ff4-9f87-a0616b8375dc" released by "_delete_snapshot" :: held 2.920s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:24:29 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7af335c0-548a-4dc6-9884-993512f43d98 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "cinder-quobyte-20b63c40-b40a-41dc-8425-e733c9f01358" released by "delete_snapshot" :: held 2.940s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:24:29 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-7af335c0-548a-4dc6-9884-993512f43d98 tempest-VolumesSnapshotTestJSON-389413737 None] Created reservations ['db9ca019-1521-414b-a8f2-203559ba9e2c', 'b01c38ed-c5d6-4f4f-a892-a1a9fb3e7938', '4d8f99f9-60d4-4934-a84a-9d6ae58da024', '88afb65a-8637-4ef5-932a-83cde5621d82'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:24:29 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-7af335c0-548a-4dc6-9884-993512f43d98 tempest-VolumesSnapshotTestJSON-389413737 None] Delete snapshot completed successfully. Apr 28 19:24:29 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7af335c0-548a-4dc6-9884-993512f43d98 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "cinder-9fb599af-031a-4ff4-9f87-a0616b8375dc-delete_snapshot" released by "delete_snapshot" :: held 3.070s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:24:29 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-51321941-3b44-4c7e-ac21-7944bf697819 tempest-VolumesSnapshotTestJSON-389413737 None] Acquiring lock "cinder-20b63c40-b40a-41dc-8425-e733c9f01358-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:24:29 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-51321941-3b44-4c7e-ac21-7944bf697819 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "cinder-20b63c40-b40a-41dc-8425-e733c9f01358-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:24:29 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-51321941-3b44-4c7e-ac21-7944bf697819 tempest-VolumesSnapshotTestJSON-389413737 None] Acquiring lock "cinder-quobyte-20b63c40-b40a-41dc-8425-e733c9f01358" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:24:29 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-51321941-3b44-4c7e-ac21-7944bf697819 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "cinder-quobyte-20b63c40-b40a-41dc-8425-e733c9f01358" acquired by "delete_volume" :: waited 0.020s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:24:29 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8ca743-fcf6-4965-94ba-73c7d34b76b5]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:24:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-51321941-3b44-4c7e-ac21-7944bf697819 tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:30 devstack sudo[92275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358 Apr 28 19:24:30 devstack sudo[92275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:30 devstack sudo[92273]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d02ad989-d640-4af7-b0fa-083aab848d41 tempest-VolumesSnapshotListTestJSON-1261208981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.372ca08c-e8fc-444f-bd22-5a4803f90cf8 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.04150c7d-168b-4676-abe5-0c32cd96c0f7" returned: 0 in 0.701s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:30 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-d02ad989-d640-4af7-b0fa-083aab848d41 tempest-VolumesSnapshotListTestJSON-1261208981 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.04150c7d-168b-4676-abe5-0c32cd96c0f7 is being set with open permissions: ugo+rw Apr 28 19:24:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d02ad989-d640-4af7-b0fa-083aab848d41 tempest-VolumesSnapshotListTestJSON-1261208981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.04150c7d-168b-4676-abe5-0c32cd96c0f7 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:30 devstack sudo[92280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.04150c7d-168b-4676-abe5-0c32cd96c0f7 Apr 28 19:24:30 devstack sudo[92280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:30 devstack sudo[92275]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-51321941-3b44-4c7e-ac21-7944bf697819 tempest-VolumesSnapshotTestJSON-389413737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358" returned: 0 in 0.709s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-51321941-3b44-4c7e-ac21-7944bf697819 tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:30 devstack sudo[92285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358 Apr 28 19:24:30 devstack sudo[92285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:30 devstack sudo[92280]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d02ad989-d640-4af7-b0fa-083aab848d41 tempest-VolumesSnapshotListTestJSON-1261208981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.04150c7d-168b-4676-abe5-0c32cd96c0f7" returned: 0 in 0.611s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d02ad989-d640-4af7-b0fa-083aab848d41 tempest-VolumesSnapshotListTestJSON-1261208981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.968s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:24:30 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-d02ad989-d640-4af7-b0fa-083aab848d41 tempest-VolumesSnapshotListTestJSON-1261208981 None] Create snapshot completed successfully Apr 28 19:24:31 devstack sudo[92285]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-51321941-3b44-4c7e-ac21-7944bf697819 tempest-VolumesSnapshotTestJSON-389413737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-20b63c40-b40a-41dc-8425-e733c9f01358" returned: 0 in 0.622s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:31 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-51321941-3b44-4c7e-ac21-7944bf697819 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "cinder-quobyte-20b63c40-b40a-41dc-8425-e733c9f01358" released by "delete_volume" :: held 1.397s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:24:31 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-51321941-3b44-4c7e-ac21-7944bf697819 tempest-VolumesSnapshotTestJSON-389413737 None] Created reservations ['748670c2-e0de-4b9d-8c86-4d268a7cc970', '243c300d-4f8e-4b73-816a-abaf9f34c903', '8d6372ca-13b3-44de-ad29-3aa6ec4a3b1c', 'd0288d42-e84f-4933-901e-03f7c6bd3d82'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:24:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-51321941-3b44-4c7e-ac21-7944bf697819 tempest-VolumesSnapshotTestJSON-389413737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:24:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-51321941-3b44-4c7e-ac21-7944bf697819 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:24:31 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-51321941-3b44-4c7e-ac21-7944bf697819 tempest-VolumesSnapshotTestJSON-389413737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:24:31 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-51321941-3b44-4c7e-ac21-7944bf697819 tempest-VolumesSnapshotTestJSON-389413737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:24:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-51321941-3b44-4c7e-ac21-7944bf697819 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:24:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-51321941-3b44-4c7e-ac21-7944bf697819 tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:31 devstack sudo[92290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:24:31 devstack sudo[92290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:31 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-197aaf33-fa92-454f-be22-4ad9a8b98f89 tempest-VolumesSnapshotListTestJSON-1261208981 None] Acquiring lock "cinder-04150c7d-168b-4676-abe5-0c32cd96c0f7-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:24:31 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-197aaf33-fa92-454f-be22-4ad9a8b98f89 tempest-VolumesSnapshotListTestJSON-1261208981 None] Lock "cinder-04150c7d-168b-4676-abe5-0c32cd96c0f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:24:31 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-197aaf33-fa92-454f-be22-4ad9a8b98f89 tempest-VolumesSnapshotListTestJSON-1261208981 None] Acquiring lock "cinder-quobyte-95dcbb59-8600-48a6-84a5-3be97022c9e7" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:24:31 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-197aaf33-fa92-454f-be22-4ad9a8b98f89 tempest-VolumesSnapshotListTestJSON-1261208981 None] Lock "cinder-quobyte-95dcbb59-8600-48a6-84a5-3be97022c9e7" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:24:31 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-197aaf33-fa92-454f-be22-4ad9a8b98f89 tempest-VolumesSnapshotListTestJSON-1261208981 None] Acquiring lock "cinder-quobyte-04150c7d-168b-4676-abe5-0c32cd96c0f7" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:24:31 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-197aaf33-fa92-454f-be22-4ad9a8b98f89 tempest-VolumesSnapshotListTestJSON-1261208981 None] Lock "cinder-quobyte-04150c7d-168b-4676-abe5-0c32cd96c0f7" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:24:31 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-197aaf33-fa92-454f-be22-4ad9a8b98f89 tempest-VolumesSnapshotListTestJSON-1261208981 None] Deleting offline snapshot 04150c7d-168b-4676-abe5-0c32cd96c0f7 of volume 95dcbb59-8600-48a6-84a5-3be97022c9e7 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 19:24:31 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-197aaf33-fa92-454f-be22-4ad9a8b98f89 tempest-VolumesSnapshotListTestJSON-1261208981 None] snapshot_file for this snap is: volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.04150c7d-168b-4676-abe5-0c32cd96c0f7 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 19:24:31 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7092a36-077d-44db-b8a8-d7f9d0d075f6]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:24:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-197aaf33-fa92-454f-be22-4ad9a8b98f89 tempest-VolumesSnapshotListTestJSON-1261208981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.04150c7d-168b-4676-abe5-0c32cd96c0f7 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:32 devstack sudo[92292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.04150c7d-168b-4676-abe5-0c32cd96c0f7 Apr 28 19:24:32 devstack sudo[92292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:32 devstack sudo[92290]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-51321941-3b44-4c7e-ac21-7944bf697819 tempest-VolumesSnapshotTestJSON-389413737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.664s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:32 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-51321941-3b44-4c7e-ac21-7944bf697819 tempest-VolumesSnapshotTestJSON-389413737 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:24:32 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-51321941-3b44-4c7e-ac21-7944bf697819 tempest-VolumesSnapshotTestJSON-389413737 None] Deleted volume successfully. Apr 28 19:24:32 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-51321941-3b44-4c7e-ac21-7944bf697819 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "cinder-20b63c40-b40a-41dc-8425-e733c9f01358-delete_volume" released by "delete_volume" :: held 2.297s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:24:32 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e723da0f-1433-4f78-8c55-13fd68896a58 tempest-VolumesSnapshotTestJSON-389413737 None] Acquiring lock "cinder-2b5d447a-818e-4a94-944c-77831dcb91f9-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:24:32 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e723da0f-1433-4f78-8c55-13fd68896a58 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "cinder-2b5d447a-818e-4a94-944c-77831dcb91f9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:24:32 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e723da0f-1433-4f78-8c55-13fd68896a58 tempest-VolumesSnapshotTestJSON-389413737 None] Acquiring lock "cinder-quobyte-2b5d447a-818e-4a94-944c-77831dcb91f9" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:24:32 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e723da0f-1433-4f78-8c55-13fd68896a58 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "cinder-quobyte-2b5d447a-818e-4a94-944c-77831dcb91f9" acquired by "delete_volume" :: waited 0.014s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:24:32 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[59aaa079-fe6a-4b0f-aba3-479643ef82a8]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:24:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e723da0f-1433-4f78-8c55-13fd68896a58 tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2b5d447a-818e-4a94-944c-77831dcb91f9 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:32 devstack sudo[92295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2b5d447a-818e-4a94-944c-77831dcb91f9 Apr 28 19:24:32 devstack sudo[92295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:32 devstack sudo[92292]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-197aaf33-fa92-454f-be22-4ad9a8b98f89 tempest-VolumesSnapshotListTestJSON-1261208981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.04150c7d-168b-4676-abe5-0c32cd96c0f7" returned: 0 in 0.813s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:32 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-197aaf33-fa92-454f-be22-4ad9a8b98f89 tempest-VolumesSnapshotListTestJSON-1261208981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95dcbb59-8600-48a6-84a5-3be97022c9e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:24:32 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3d580c-f091-42e0-b2aa-4a997b1f74b4]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:24:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-197aaf33-fa92-454f-be22-4ad9a8b98f89 tempest-VolumesSnapshotListTestJSON-1261208981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.372ca08c-e8fc-444f-bd22-5a4803f90cf8 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:32 devstack sudo[92300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.372ca08c-e8fc-444f-bd22-5a4803f90cf8 Apr 28 19:24:32 devstack sudo[92300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:33 devstack sudo[92295]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e723da0f-1433-4f78-8c55-13fd68896a58 tempest-VolumesSnapshotTestJSON-389413737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2b5d447a-818e-4a94-944c-77831dcb91f9" returned: 0 in 0.726s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e723da0f-1433-4f78-8c55-13fd68896a58 tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2b5d447a-818e-4a94-944c-77831dcb91f9 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:33 devstack sudo[92305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2b5d447a-818e-4a94-944c-77831dcb91f9 Apr 28 19:24:33 devstack sudo[92305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:33 devstack sudo[92300]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-197aaf33-fa92-454f-be22-4ad9a8b98f89 tempest-VolumesSnapshotListTestJSON-1261208981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.372ca08c-e8fc-444f-bd22-5a4803f90cf8" returned: 0 in 0.736s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-197aaf33-fa92-454f-be22-4ad9a8b98f89 tempest-VolumesSnapshotListTestJSON-1261208981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95dcbb59-8600-48a6-84a5-3be97022c9e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:24:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-197aaf33-fa92-454f-be22-4ad9a8b98f89 tempest-VolumesSnapshotListTestJSON-1261208981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.04150c7d-168b-4676-abe5-0c32cd96c0f7 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:33 devstack sudo[92310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.04150c7d-168b-4676-abe5-0c32cd96c0f7 Apr 28 19:24:33 devstack sudo[92310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:33 devstack sudo[92305]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e723da0f-1433-4f78-8c55-13fd68896a58 tempest-VolumesSnapshotTestJSON-389413737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2b5d447a-818e-4a94-944c-77831dcb91f9" returned: 0 in 0.631s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:33 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e723da0f-1433-4f78-8c55-13fd68896a58 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "cinder-quobyte-2b5d447a-818e-4a94-944c-77831dcb91f9" released by "delete_volume" :: held 1.414s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:24:33 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-e723da0f-1433-4f78-8c55-13fd68896a58 tempest-VolumesSnapshotTestJSON-389413737 None] Created reservations ['b1158acf-a671-4d8f-82a2-24961fcdd83b', '2a5213a4-64c9-491b-9225-9d97c4688a5f', '751e9928-e6a1-421f-995d-b2bb173d33de', '18d2cf9b-fdba-4880-8049-fd7ac5ede89a'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:24:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e723da0f-1433-4f78-8c55-13fd68896a58 tempest-VolumesSnapshotTestJSON-389413737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:24:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e723da0f-1433-4f78-8c55-13fd68896a58 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:24:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-e723da0f-1433-4f78-8c55-13fd68896a58 tempest-VolumesSnapshotTestJSON-389413737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:24:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-e723da0f-1433-4f78-8c55-13fd68896a58 tempest-VolumesSnapshotTestJSON-389413737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:24:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e723da0f-1433-4f78-8c55-13fd68896a58 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:24:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e723da0f-1433-4f78-8c55-13fd68896a58 tempest-VolumesSnapshotTestJSON-389413737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:33 devstack sudo[92313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:24:33 devstack sudo[92313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:34 devstack sudo[92310]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-197aaf33-fa92-454f-be22-4ad9a8b98f89 tempest-VolumesSnapshotListTestJSON-1261208981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.04150c7d-168b-4676-abe5-0c32cd96c0f7" returned: 0 in 0.797s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-197aaf33-fa92-454f-be22-4ad9a8b98f89 tempest-VolumesSnapshotListTestJSON-1261208981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.04150c7d-168b-4676-abe5-0c32cd96c0f7 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:34 devstack sudo[92320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.04150c7d-168b-4676-abe5-0c32cd96c0f7 Apr 28 19:24:34 devstack sudo[92320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:34 devstack sudo[92313]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e723da0f-1433-4f78-8c55-13fd68896a58 tempest-VolumesSnapshotTestJSON-389413737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.696s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:34 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-e723da0f-1433-4f78-8c55-13fd68896a58 tempest-VolumesSnapshotTestJSON-389413737 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:24:34 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-e723da0f-1433-4f78-8c55-13fd68896a58 tempest-VolumesSnapshotTestJSON-389413737 None] Deleted volume successfully. Apr 28 19:24:34 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e723da0f-1433-4f78-8c55-13fd68896a58 tempest-VolumesSnapshotTestJSON-389413737 None] Lock "cinder-2b5d447a-818e-4a94-944c-77831dcb91f9-delete_volume" released by "delete_volume" :: held 2.332s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:24:34 devstack sudo[92320]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-197aaf33-fa92-454f-be22-4ad9a8b98f89 tempest-VolumesSnapshotListTestJSON-1261208981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.04150c7d-168b-4676-abe5-0c32cd96c0f7" returned: 0 in 0.624s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:34 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-197aaf33-fa92-454f-be22-4ad9a8b98f89 tempest-VolumesSnapshotListTestJSON-1261208981 None] Lock "cinder-quobyte-04150c7d-168b-4676-abe5-0c32cd96c0f7" released by "_delete_snapshot" :: held 3.059s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:24:34 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-197aaf33-fa92-454f-be22-4ad9a8b98f89 tempest-VolumesSnapshotListTestJSON-1261208981 None] Lock "cinder-quobyte-95dcbb59-8600-48a6-84a5-3be97022c9e7" released by "delete_snapshot" :: held 3.081s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:24:34 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-197aaf33-fa92-454f-be22-4ad9a8b98f89 tempest-VolumesSnapshotListTestJSON-1261208981 None] Created reservations ['219f8d88-3894-4f01-b427-02f767a55e6d', '0386ebbb-8374-48ac-83ac-d73d669e6c47', 'c3470429-111f-4559-a77e-841991631824', '5b743765-aab8-4a33-aef2-5ed726052ec2'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:24:35 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-197aaf33-fa92-454f-be22-4ad9a8b98f89 tempest-VolumesSnapshotListTestJSON-1261208981 None] Delete snapshot completed successfully. Apr 28 19:24:35 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-197aaf33-fa92-454f-be22-4ad9a8b98f89 tempest-VolumesSnapshotListTestJSON-1261208981 None] Lock "cinder-04150c7d-168b-4676-abe5-0c32cd96c0f7-delete_snapshot" released by "delete_snapshot" :: held 3.252s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:24:36 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0f4cc5b0-b207-48e5-946e-cf24e45202ba tempest-VolumesSnapshotListTestJSON-1261208981 None] Acquiring lock "cinder-372ca08c-e8fc-444f-bd22-5a4803f90cf8-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:24:36 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0f4cc5b0-b207-48e5-946e-cf24e45202ba tempest-VolumesSnapshotListTestJSON-1261208981 None] Lock "cinder-372ca08c-e8fc-444f-bd22-5a4803f90cf8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:24:36 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0f4cc5b0-b207-48e5-946e-cf24e45202ba tempest-VolumesSnapshotListTestJSON-1261208981 None] Acquiring lock "cinder-quobyte-95dcbb59-8600-48a6-84a5-3be97022c9e7" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:24:36 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0f4cc5b0-b207-48e5-946e-cf24e45202ba tempest-VolumesSnapshotListTestJSON-1261208981 None] Lock "cinder-quobyte-95dcbb59-8600-48a6-84a5-3be97022c9e7" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:24:36 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0f4cc5b0-b207-48e5-946e-cf24e45202ba tempest-VolumesSnapshotListTestJSON-1261208981 None] Acquiring lock "cinder-quobyte-372ca08c-e8fc-444f-bd22-5a4803f90cf8" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:24:36 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0f4cc5b0-b207-48e5-946e-cf24e45202ba tempest-VolumesSnapshotListTestJSON-1261208981 None] Lock "cinder-quobyte-372ca08c-e8fc-444f-bd22-5a4803f90cf8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:24:36 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-0f4cc5b0-b207-48e5-946e-cf24e45202ba tempest-VolumesSnapshotListTestJSON-1261208981 None] Deleting offline snapshot 372ca08c-e8fc-444f-bd22-5a4803f90cf8 of volume 95dcbb59-8600-48a6-84a5-3be97022c9e7 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 19:24:36 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-0f4cc5b0-b207-48e5-946e-cf24e45202ba tempest-VolumesSnapshotListTestJSON-1261208981 None] snapshot_file for this snap is: volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.372ca08c-e8fc-444f-bd22-5a4803f90cf8 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 19:24:36 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[702a6152-6165-4710-8d54-7029f23d5ca5]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:24:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0f4cc5b0-b207-48e5-946e-cf24e45202ba tempest-VolumesSnapshotListTestJSON-1261208981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.372ca08c-e8fc-444f-bd22-5a4803f90cf8 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:36 devstack sudo[92325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.372ca08c-e8fc-444f-bd22-5a4803f90cf8 Apr 28 19:24:36 devstack sudo[92325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:36 devstack sudo[92325]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0f4cc5b0-b207-48e5-946e-cf24e45202ba tempest-VolumesSnapshotListTestJSON-1261208981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.372ca08c-e8fc-444f-bd22-5a4803f90cf8" returned: 0 in 0.754s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:36 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-0f4cc5b0-b207-48e5-946e-cf24e45202ba tempest-VolumesSnapshotListTestJSON-1261208981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95dcbb59-8600-48a6-84a5-3be97022c9e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:24:36 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[062acc4c-2667-47f4-8dab-53c3d99e759d]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:24:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0f4cc5b0-b207-48e5-946e-cf24e45202ba tempest-VolumesSnapshotListTestJSON-1261208981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.4515f431-cf23-42e5-adc3-d91d8c135f4a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:37 devstack sudo[92330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.4515f431-cf23-42e5-adc3-d91d8c135f4a Apr 28 19:24:37 devstack sudo[92330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:37 devstack sudo[92330]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0f4cc5b0-b207-48e5-946e-cf24e45202ba tempest-VolumesSnapshotListTestJSON-1261208981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.4515f431-cf23-42e5-adc3-d91d8c135f4a" returned: 0 in 0.819s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:37 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-0f4cc5b0-b207-48e5-946e-cf24e45202ba tempest-VolumesSnapshotListTestJSON-1261208981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95dcbb59-8600-48a6-84a5-3be97022c9e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:24:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0f4cc5b0-b207-48e5-946e-cf24e45202ba tempest-VolumesSnapshotListTestJSON-1261208981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.372ca08c-e8fc-444f-bd22-5a4803f90cf8 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:37 devstack sudo[92350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.372ca08c-e8fc-444f-bd22-5a4803f90cf8 Apr 28 19:24:37 devstack sudo[92350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:38 devstack sudo[92350]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0f4cc5b0-b207-48e5-946e-cf24e45202ba tempest-VolumesSnapshotListTestJSON-1261208981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.372ca08c-e8fc-444f-bd22-5a4803f90cf8" returned: 0 in 0.896s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0f4cc5b0-b207-48e5-946e-cf24e45202ba tempest-VolumesSnapshotListTestJSON-1261208981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.372ca08c-e8fc-444f-bd22-5a4803f90cf8 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:38 devstack sudo[92379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.372ca08c-e8fc-444f-bd22-5a4803f90cf8 Apr 28 19:24:38 devstack sudo[92379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:39 devstack sudo[92379]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0f4cc5b0-b207-48e5-946e-cf24e45202ba tempest-VolumesSnapshotListTestJSON-1261208981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.372ca08c-e8fc-444f-bd22-5a4803f90cf8" returned: 0 in 0.634s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:39 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0f4cc5b0-b207-48e5-946e-cf24e45202ba tempest-VolumesSnapshotListTestJSON-1261208981 None] Lock "cinder-quobyte-372ca08c-e8fc-444f-bd22-5a4803f90cf8" released by "_delete_snapshot" :: held 3.242s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:24:39 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0f4cc5b0-b207-48e5-946e-cf24e45202ba tempest-VolumesSnapshotListTestJSON-1261208981 None] Lock "cinder-quobyte-95dcbb59-8600-48a6-84a5-3be97022c9e7" released by "delete_snapshot" :: held 3.267s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:24:39 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-0f4cc5b0-b207-48e5-946e-cf24e45202ba tempest-VolumesSnapshotListTestJSON-1261208981 None] Created reservations ['8eb49646-bc6d-4356-92e8-9fb79739b3b8', '3e2bf6e5-7829-40d5-bdfe-c5a9003b448c', '0e77d1ea-ccde-4a8b-b20f-24f097234a5a', '6a350c0f-396f-41c7-ad77-01c59b4de39c'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:24:39 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-0f4cc5b0-b207-48e5-946e-cf24e45202ba tempest-VolumesSnapshotListTestJSON-1261208981 None] Delete snapshot completed successfully. Apr 28 19:24:39 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0f4cc5b0-b207-48e5-946e-cf24e45202ba tempest-VolumesSnapshotListTestJSON-1261208981 None] Lock "cinder-372ca08c-e8fc-444f-bd22-5a4803f90cf8-delete_snapshot" released by "delete_snapshot" :: held 3.406s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:24:40 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-41719a4f-6d61-43e9-a981-6342000dbcd3 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:24:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-41719a4f-6d61-43e9-a981-6342000dbcd3 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Flow 'volume_create_manager' (3fc14a9b-6bcf-457c-9f72-80ce4302670d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:24:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-41719a4f-6d61-43e9-a981-6342000dbcd3 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b560c716-53ae-400e-9a4e-56e39e410f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-41719a4f-6d61-43e9-a981-6342000dbcd3 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b560c716-53ae-400e-9a4e-56e39e410f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1896926357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc9024ef-4052-4c2a-af6f-a25b140e32d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ad5b5ba7ef045caaf64db1a2862c07a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:24:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:24:40Z,use_quota=True,user_id='945f6455008e48ddaee67eac3b202ae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:24:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-41719a4f-6d61-43e9-a981-6342000dbcd3 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e989c820-99c6-4624-8d03-905406485190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-41719a4f-6d61-43e9-a981-6342000dbcd3 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e989c820-99c6-4624-8d03-905406485190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:24:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-41719a4f-6d61-43e9-a981-6342000dbcd3 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebd0f246-f711-4d33-8a5d-4701ad87b39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-41719a4f-6d61-43e9-a981-6342000dbcd3 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebd0f246-f711-4d33-8a5d-4701ad87b39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc9024ef-4052-4c2a-af6f-a25b140e32d6', 'volume_name': 'volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6', 'volume_size': 2}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:24:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-41719a4f-6d61-43e9-a981-6342000dbcd3 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5da625a-1c87-4dde-94f4-dbda7bdf028b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-41719a4f-6d61-43e9-a981-6342000dbcd3 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5da625a-1c87-4dde-94f4-dbda7bdf028b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:24:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-41719a4f-6d61-43e9-a981-6342000dbcd3 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81014448-fb74-437a-ace7-7dd239ed5c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:40 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-41719a4f-6d61-43e9-a981-6342000dbcd3 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Volume cc9024ef-4052-4c2a-af6f-a25b140e32d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6', 'volume_size': 2} Apr 28 19:24:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-41719a4f-6d61-43e9-a981-6342000dbcd3 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:24:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-41719a4f-6d61-43e9-a981-6342000dbcd3 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:24:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-41719a4f-6d61-43e9-a981-6342000dbcd3 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1896926357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc9024ef-4052-4c2a-af6f-a25b140e32d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ad5b5ba7ef045caaf64db1a2862c07a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:24:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:24:40Z,use_quota=True,user_id='945f6455008e48ddaee67eac3b202ae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:24:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-41719a4f-6d61-43e9-a981-6342000dbcd3 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Creating volume cc9024ef-4052-4c2a-af6f-a25b140e32d6 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:24:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-41719a4f-6d61-43e9-a981-6342000dbcd3 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:24:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-41719a4f-6d61-43e9-a981-6342000dbcd3 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:24:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-41719a4f-6d61-43e9-a981-6342000dbcd3 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:24:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-41719a4f-6d61-43e9-a981-6342000dbcd3 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:24:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-41719a4f-6d61-43e9-a981-6342000dbcd3 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:24:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-41719a4f-6d61-43e9-a981-6342000dbcd3 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:24:40 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-41719a4f-6d61-43e9-a981-6342000dbcd3 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:24:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-41719a4f-6d61-43e9-a981-6342000dbcd3 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6 2147483648 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:40 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8d800295-6506-4775-84c5-ad49934c73cf tempest-VolumesSnapshotListTestJSON-1261208981 None] Acquiring lock "cinder-4515f431-cf23-42e5-adc3-d91d8c135f4a-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:24:40 devstack sudo[92382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6 2147483648 Apr 28 19:24:40 devstack sudo[92382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:40 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8d800295-6506-4775-84c5-ad49934c73cf tempest-VolumesSnapshotListTestJSON-1261208981 None] Lock "cinder-4515f431-cf23-42e5-adc3-d91d8c135f4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:24:40 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8d800295-6506-4775-84c5-ad49934c73cf tempest-VolumesSnapshotListTestJSON-1261208981 None] Acquiring lock "cinder-quobyte-95dcbb59-8600-48a6-84a5-3be97022c9e7" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:24:40 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8d800295-6506-4775-84c5-ad49934c73cf tempest-VolumesSnapshotListTestJSON-1261208981 None] Lock "cinder-quobyte-95dcbb59-8600-48a6-84a5-3be97022c9e7" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:24:40 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8d800295-6506-4775-84c5-ad49934c73cf tempest-VolumesSnapshotListTestJSON-1261208981 None] Acquiring lock "cinder-quobyte-4515f431-cf23-42e5-adc3-d91d8c135f4a" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:24:40 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8d800295-6506-4775-84c5-ad49934c73cf tempest-VolumesSnapshotListTestJSON-1261208981 None] Lock "cinder-quobyte-4515f431-cf23-42e5-adc3-d91d8c135f4a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:24:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-8d800295-6506-4775-84c5-ad49934c73cf tempest-VolumesSnapshotListTestJSON-1261208981 None] Deleting offline snapshot 4515f431-cf23-42e5-adc3-d91d8c135f4a of volume 95dcbb59-8600-48a6-84a5-3be97022c9e7 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 19:24:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-8d800295-6506-4775-84c5-ad49934c73cf tempest-VolumesSnapshotListTestJSON-1261208981 None] snapshot_file for this snap is: volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.4515f431-cf23-42e5-adc3-d91d8c135f4a {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 19:24:40 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e2c144-032b-4006-81fe-e6c7c674880f]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:24:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8d800295-6506-4775-84c5-ad49934c73cf tempest-VolumesSnapshotListTestJSON-1261208981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.4515f431-cf23-42e5-adc3-d91d8c135f4a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:40 devstack sudo[92384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.4515f431-cf23-42e5-adc3-d91d8c135f4a Apr 28 19:24:40 devstack sudo[92384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:41 devstack sudo[92382]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-41719a4f-6d61-43e9-a981-6342000dbcd3 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6 2147483648" returned: 0 in 0.848s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:41 devstack sudo[92384]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8d800295-6506-4775-84c5-ad49934c73cf tempest-VolumesSnapshotListTestJSON-1261208981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.4515f431-cf23-42e5-adc3-d91d8c135f4a" returned: 0 in 0.739s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:41 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-8d800295-6506-4775-84c5-ad49934c73cf tempest-VolumesSnapshotListTestJSON-1261208981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95dcbb59-8600-48a6-84a5-3be97022c9e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:24:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-41719a4f-6d61-43e9-a981-6342000dbcd3 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:41 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca7e2aa-d053-4ece-a63d-f86b991223e3]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:24:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8d800295-6506-4775-84c5-ad49934c73cf tempest-VolumesSnapshotListTestJSON-1261208981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:41 devstack sudo[92393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6 Apr 28 19:24:41 devstack sudo[92393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:41 devstack sudo[92394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7 Apr 28 19:24:41 devstack sudo[92394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:41 devstack sudo[92393]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-41719a4f-6d61-43e9-a981-6342000dbcd3 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6" returned: 0 in 0.615s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:41 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-41719a4f-6d61-43e9-a981-6342000dbcd3 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] <== create_volume: return (1529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:24:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-41719a4f-6d61-43e9-a981-6342000dbcd3 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.532s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:24:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-41719a4f-6d61-43e9-a981-6342000dbcd3 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81014448-fb74-437a-ace7-7dd239ed5c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6', 'volume_size': 2}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:24:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-41719a4f-6d61-43e9-a981-6342000dbcd3 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9283f83c-d818-4091-b57a-162950374462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:41 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-41719a4f-6d61-43e9-a981-6342000dbcd3 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Volume volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6 (cc9024ef-4052-4c2a-af6f-a25b140e32d6): created successfully Apr 28 19:24:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-41719a4f-6d61-43e9-a981-6342000dbcd3 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9283f83c-d818-4091-b57a-162950374462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:24:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-41719a4f-6d61-43e9-a981-6342000dbcd3 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Flow 'volume_create_manager' (3fc14a9b-6bcf-457c-9f72-80ce4302670d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:24:41 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-41719a4f-6d61-43e9-a981-6342000dbcd3 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Created volume successfully. Apr 28 19:24:41 devstack sudo[92394]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8d800295-6506-4775-84c5-ad49934c73cf tempest-VolumesSnapshotListTestJSON-1261208981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7" returned: 0 in 0.742s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8d800295-6506-4775-84c5-ad49934c73cf tempest-VolumesSnapshotListTestJSON-1261208981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.4515f431-cf23-42e5-adc3-d91d8c135f4a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:41 devstack sudo[92401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.4515f431-cf23-42e5-adc3-d91d8c135f4a Apr 28 19:24:41 devstack sudo[92401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-bef2e0e7-b6d4-4914-9eb6-635650487957 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:24:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-bef2e0e7-b6d4-4914-9eb6-635650487957 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:24:42 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-bef2e0e7-b6d4-4914-9eb6-635650487957 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Creating offline snapshot 5730c383-f597-40c5-b13e-344a65c57364 of volume cc9024ef-4052-4c2a-af6f-a25b140e32d6 {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 19:24:42 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[533c4b35-b0a1-4f83-9dfb-8bf074c665d4]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:24:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bef2e0e7-b6d4-4914-9eb6-635650487957 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:42 devstack sudo[92406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6 Apr 28 19:24:42 devstack sudo[92406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:42 devstack sudo[92401]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8d800295-6506-4775-84c5-ad49934c73cf tempest-VolumesSnapshotListTestJSON-1261208981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.4515f431-cf23-42e5-adc3-d91d8c135f4a" returned: 0 in 0.738s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8d800295-6506-4775-84c5-ad49934c73cf tempest-VolumesSnapshotListTestJSON-1261208981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.4515f431-cf23-42e5-adc3-d91d8c135f4a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:42 devstack sudo[92409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.4515f431-cf23-42e5-adc3-d91d8c135f4a Apr 28 19:24:42 devstack sudo[92409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:43 devstack sudo[92406]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bef2e0e7-b6d4-4914-9eb6-635650487957 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6" returned: 0 in 0.726s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bef2e0e7-b6d4-4914-9eb6-635650487957 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6.5730c383-f597-40c5-b13e-344a65c57364 2G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:43 devstack sudo[92409]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8d800295-6506-4775-84c5-ad49934c73cf tempest-VolumesSnapshotListTestJSON-1261208981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7.4515f431-cf23-42e5-adc3-d91d8c135f4a" returned: 0 in 0.610s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:43 devstack sudo[92415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6.5730c383-f597-40c5-b13e-344a65c57364 2G Apr 28 19:24:43 devstack sudo[92415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:43 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8d800295-6506-4775-84c5-ad49934c73cf tempest-VolumesSnapshotListTestJSON-1261208981 None] Lock "cinder-quobyte-4515f431-cf23-42e5-adc3-d91d8c135f4a" released by "_delete_snapshot" :: held 2.976s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:24:43 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8d800295-6506-4775-84c5-ad49934c73cf tempest-VolumesSnapshotListTestJSON-1261208981 None] Lock "cinder-quobyte-95dcbb59-8600-48a6-84a5-3be97022c9e7" released by "delete_snapshot" :: held 3.004s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:24:43 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-8d800295-6506-4775-84c5-ad49934c73cf tempest-VolumesSnapshotListTestJSON-1261208981 None] Created reservations ['a8824974-a553-47d9-9023-e09c78c39d5b', 'ad1e172e-047b-41d6-b6c2-63ca16fe1f44', '9411a8eb-2490-4bd0-9b7c-9c909d1a341f', '32629a4a-7355-4c41-a016-69984fcc7f86'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:24:43 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-8d800295-6506-4775-84c5-ad49934c73cf tempest-VolumesSnapshotListTestJSON-1261208981 None] Delete snapshot completed successfully. Apr 28 19:24:43 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8d800295-6506-4775-84c5-ad49934c73cf tempest-VolumesSnapshotListTestJSON-1261208981 None] Lock "cinder-4515f431-cf23-42e5-adc3-d91d8c135f4a-delete_snapshot" released by "delete_snapshot" :: held 3.146s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:24:44 devstack sudo[92415]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bef2e0e7-b6d4-4914-9eb6-635650487957 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6.5730c383-f597-40c5-b13e-344a65c57364 2G" returned: 0 in 0.755s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bef2e0e7-b6d4-4914-9eb6-635650487957 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6.5730c383-f597-40c5-b13e-344a65c57364 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:44 devstack sudo[92420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6.5730c383-f597-40c5-b13e-344a65c57364 Apr 28 19:24:44 devstack sudo[92420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:44 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-db677a0b-1063-4ccc-8796-dde0bd4a4357 tempest-VolumesSnapshotListTestJSON-1261208981 None] Acquiring lock "cinder-95dcbb59-8600-48a6-84a5-3be97022c9e7-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:24:44 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-db677a0b-1063-4ccc-8796-dde0bd4a4357 tempest-VolumesSnapshotListTestJSON-1261208981 None] Lock "cinder-95dcbb59-8600-48a6-84a5-3be97022c9e7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:24:44 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-db677a0b-1063-4ccc-8796-dde0bd4a4357 tempest-VolumesSnapshotListTestJSON-1261208981 None] Acquiring lock "cinder-quobyte-95dcbb59-8600-48a6-84a5-3be97022c9e7" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:24:44 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-db677a0b-1063-4ccc-8796-dde0bd4a4357 tempest-VolumesSnapshotListTestJSON-1261208981 None] Lock "cinder-quobyte-95dcbb59-8600-48a6-84a5-3be97022c9e7" acquired by "delete_volume" :: waited 0.016s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:24:44 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5d077e-1676-46d5-b055-871c5c162a3f]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:24:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-db677a0b-1063-4ccc-8796-dde0bd4a4357 tempest-VolumesSnapshotListTestJSON-1261208981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:44 devstack sudo[92420]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bef2e0e7-b6d4-4914-9eb6-635650487957 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6.5730c383-f597-40c5-b13e-344a65c57364" returned: 0 in 0.665s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:44 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-bef2e0e7-b6d4-4914-9eb6-635650487957 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6.5730c383-f597-40c5-b13e-344a65c57364 is being set with open permissions: ugo+rw Apr 28 19:24:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bef2e0e7-b6d4-4914-9eb6-635650487957 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6.5730c383-f597-40c5-b13e-344a65c57364 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:44 devstack sudo[92427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6.5730c383-f597-40c5-b13e-344a65c57364 Apr 28 19:24:44 devstack sudo[92427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:44 devstack sudo[92426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7 Apr 28 19:24:44 devstack sudo[92426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:45 devstack sudo[92427]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bef2e0e7-b6d4-4914-9eb6-635650487957 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6.5730c383-f597-40c5-b13e-344a65c57364" returned: 0 in 0.592s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bef2e0e7-b6d4-4914-9eb6-635650487957 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:45 devstack sudo[92434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6.info Apr 28 19:24:45 devstack sudo[92434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:45 devstack sudo[92426]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-db677a0b-1063-4ccc-8796-dde0bd4a4357 tempest-VolumesSnapshotListTestJSON-1261208981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7" returned: 0 in 0.741s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-db677a0b-1063-4ccc-8796-dde0bd4a4357 tempest-VolumesSnapshotListTestJSON-1261208981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:45 devstack sudo[92436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7 Apr 28 19:24:45 devstack sudo[92436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:45 devstack sudo[92434]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bef2e0e7-b6d4-4914-9eb6-635650487957 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6.info" returned: 0 in 0.621s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:45 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-bef2e0e7-b6d4-4914-9eb6-635650487957 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6.info is being set with open permissions: ugo+rw Apr 28 19:24:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bef2e0e7-b6d4-4914-9eb6-635650487957 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:45 devstack sudo[92440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6.info Apr 28 19:24:45 devstack sudo[92440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:46 devstack sudo[92436]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-db677a0b-1063-4ccc-8796-dde0bd4a4357 tempest-VolumesSnapshotListTestJSON-1261208981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-95dcbb59-8600-48a6-84a5-3be97022c9e7" returned: 0 in 0.621s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:46 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-db677a0b-1063-4ccc-8796-dde0bd4a4357 tempest-VolumesSnapshotListTestJSON-1261208981 None] Lock "cinder-quobyte-95dcbb59-8600-48a6-84a5-3be97022c9e7" released by "delete_volume" :: held 1.425s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:24:46 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-db677a0b-1063-4ccc-8796-dde0bd4a4357 tempest-VolumesSnapshotListTestJSON-1261208981 None] Created reservations ['cc041391-da81-489c-8616-4743a3963450', '86d0ee2b-6257-4057-970d-812d459d2560', 'f8f0f2a2-e1ab-4f28-b328-468ff949cf52', 'abdec52c-576d-42ba-abb0-4dad1cea7ba6'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:24:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-db677a0b-1063-4ccc-8796-dde0bd4a4357 tempest-VolumesSnapshotListTestJSON-1261208981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:24:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-db677a0b-1063-4ccc-8796-dde0bd4a4357 tempest-VolumesSnapshotListTestJSON-1261208981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:24:46 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-db677a0b-1063-4ccc-8796-dde0bd4a4357 tempest-VolumesSnapshotListTestJSON-1261208981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:24:46 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-db677a0b-1063-4ccc-8796-dde0bd4a4357 tempest-VolumesSnapshotListTestJSON-1261208981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:24:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-db677a0b-1063-4ccc-8796-dde0bd4a4357 tempest-VolumesSnapshotListTestJSON-1261208981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:24:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-db677a0b-1063-4ccc-8796-dde0bd4a4357 tempest-VolumesSnapshotListTestJSON-1261208981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:46 devstack sudo[92445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:24:46 devstack sudo[92445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:46 devstack sudo[92440]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bef2e0e7-b6d4-4914-9eb6-635650487957 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6.info" returned: 0 in 0.615s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-bef2e0e7-b6d4-4914-9eb6-635650487957 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.067s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:24:46 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-bef2e0e7-b6d4-4914-9eb6-635650487957 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Create snapshot completed successfully Apr 28 19:24:46 devstack sudo[92445]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-db677a0b-1063-4ccc-8796-dde0bd4a4357 tempest-VolumesSnapshotListTestJSON-1261208981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.677s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:46 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-db677a0b-1063-4ccc-8796-dde0bd4a4357 tempest-VolumesSnapshotListTestJSON-1261208981 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:24:46 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-db677a0b-1063-4ccc-8796-dde0bd4a4357 tempest-VolumesSnapshotListTestJSON-1261208981 None] Deleted volume successfully. Apr 28 19:24:46 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-db677a0b-1063-4ccc-8796-dde0bd4a4357 tempest-VolumesSnapshotListTestJSON-1261208981 None] Lock "cinder-95dcbb59-8600-48a6-84a5-3be97022c9e7-delete_volume" released by "delete_volume" :: held 2.302s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:24:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-27a1ca4c-6328-435f-8ed7-7719da5f30db tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Acquiring lock "cinder-5730c383-f597-40c5-b13e-344a65c57364-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:24:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-27a1ca4c-6328-435f-8ed7-7719da5f30db tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Lock "cinder-5730c383-f597-40c5-b13e-344a65c57364-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:24:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-27a1ca4c-6328-435f-8ed7-7719da5f30db tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Acquiring lock "cinder-quobyte-cc9024ef-4052-4c2a-af6f-a25b140e32d6" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:24:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-27a1ca4c-6328-435f-8ed7-7719da5f30db tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Lock "cinder-quobyte-cc9024ef-4052-4c2a-af6f-a25b140e32d6" acquired by "delete_snapshot" :: waited 0.024s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:24:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-27a1ca4c-6328-435f-8ed7-7719da5f30db tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Acquiring lock "cinder-quobyte-5730c383-f597-40c5-b13e-344a65c57364" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:24:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-27a1ca4c-6328-435f-8ed7-7719da5f30db tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Lock "cinder-quobyte-5730c383-f597-40c5-b13e-344a65c57364" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:24:47 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-27a1ca4c-6328-435f-8ed7-7719da5f30db tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Deleting offline snapshot 5730c383-f597-40c5-b13e-344a65c57364 of volume cc9024ef-4052-4c2a-af6f-a25b140e32d6 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 19:24:47 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-27a1ca4c-6328-435f-8ed7-7719da5f30db tempest-VolumesSnapshotNegativeTestJSON-920273551 None] snapshot_file for this snap is: volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6.5730c383-f597-40c5-b13e-344a65c57364 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 19:24:47 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7eaa9e-27ff-479d-9482-16f8727c47d1]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:24:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-27a1ca4c-6328-435f-8ed7-7719da5f30db tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6.5730c383-f597-40c5-b13e-344a65c57364 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:48 devstack sudo[92452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6.5730c383-f597-40c5-b13e-344a65c57364 Apr 28 19:24:48 devstack sudo[92452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:48 devstack sudo[92452]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-27a1ca4c-6328-435f-8ed7-7719da5f30db tempest-VolumesSnapshotNegativeTestJSON-920273551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6.5730c383-f597-40c5-b13e-344a65c57364" returned: 0 in 0.768s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:48 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-27a1ca4c-6328-435f-8ed7-7719da5f30db tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:24:48 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[921f4ca9-1ffb-4d20-b202-bd9324c735f6]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:24:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-27a1ca4c-6328-435f-8ed7-7719da5f30db tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:48 devstack sudo[92459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6 Apr 28 19:24:48 devstack sudo[92459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:49 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-072e356e-ed3e-4256-97df-0dab4b94c2de tempest-CreateVolumesFromSnapshotTest-168877895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:24:49 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-072e356e-ed3e-4256-97df-0dab4b94c2de tempest-CreateVolumesFromSnapshotTest-168877895 None] Flow 'volume_create_manager' (0f6be0ae-5575-431e-b0e7-d166dd2ada16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:24:49 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-072e356e-ed3e-4256-97df-0dab4b94c2de tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c232902c-3b85-411d-bea0-38bd6a95d857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:49 devstack sudo[92459]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-27a1ca4c-6328-435f-8ed7-7719da5f30db tempest-VolumesSnapshotNegativeTestJSON-920273551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6" returned: 0 in 0.773s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-27a1ca4c-6328-435f-8ed7-7719da5f30db tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6.5730c383-f597-40c5-b13e-344a65c57364 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:49 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-072e356e-ed3e-4256-97df-0dab4b94c2de tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c232902c-3b85-411d-bea0-38bd6a95d857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1860909594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65c727c7-8689-44b6-b721-bdd8582e0c00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daec59bcd0e540df98e2e349332b2578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:24:49Z,use_quota=True,user_id='f5bad6057d28482bb7e5f273ee32cd63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:24:49 devstack sudo[92464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6.5730c383-f597-40c5-b13e-344a65c57364 Apr 28 19:24:49 devstack sudo[92464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:49 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-072e356e-ed3e-4256-97df-0dab4b94c2de tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (489cf7cd-fefe-4923-a8e4-6a3b13a3b33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:49 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-072e356e-ed3e-4256-97df-0dab4b94c2de tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (489cf7cd-fefe-4923-a8e4-6a3b13a3b33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:24:49 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-072e356e-ed3e-4256-97df-0dab4b94c2de tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feed25a7-ab30-4be0-822a-b998ea13a31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:49 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-072e356e-ed3e-4256-97df-0dab4b94c2de tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feed25a7-ab30-4be0-822a-b998ea13a31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65c727c7-8689-44b6-b721-bdd8582e0c00', 'volume_name': 'volume-65c727c7-8689-44b6-b721-bdd8582e0c00', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:24:49 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-072e356e-ed3e-4256-97df-0dab4b94c2de tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29a19310-0ec6-445e-bcd9-9d38bcfebac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:49 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-072e356e-ed3e-4256-97df-0dab4b94c2de tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29a19310-0ec6-445e-bcd9-9d38bcfebac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:24:49 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-072e356e-ed3e-4256-97df-0dab4b94c2de tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c75ba951-619a-4a09-bc6b-4905467711cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:49 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-072e356e-ed3e-4256-97df-0dab4b94c2de tempest-CreateVolumesFromSnapshotTest-168877895 None] Volume 65c727c7-8689-44b6-b721-bdd8582e0c00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65c727c7-8689-44b6-b721-bdd8582e0c00', 'volume_size': 1} Apr 28 19:24:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-072e356e-ed3e-4256-97df-0dab4b94c2de tempest-CreateVolumesFromSnapshotTest-168877895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:24:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-072e356e-ed3e-4256-97df-0dab4b94c2de tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:24:49 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-072e356e-ed3e-4256-97df-0dab4b94c2de tempest-CreateVolumesFromSnapshotTest-168877895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1860909594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65c727c7-8689-44b6-b721-bdd8582e0c00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daec59bcd0e540df98e2e349332b2578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:24:49Z,use_quota=True,user_id='f5bad6057d28482bb7e5f273ee32cd63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:24:49 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-072e356e-ed3e-4256-97df-0dab4b94c2de tempest-CreateVolumesFromSnapshotTest-168877895 None] Creating volume 65c727c7-8689-44b6-b721-bdd8582e0c00 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:24:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-072e356e-ed3e-4256-97df-0dab4b94c2de tempest-CreateVolumesFromSnapshotTest-168877895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:24:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-072e356e-ed3e-4256-97df-0dab4b94c2de tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:24:49 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-072e356e-ed3e-4256-97df-0dab4b94c2de tempest-CreateVolumesFromSnapshotTest-168877895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:24:49 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-072e356e-ed3e-4256-97df-0dab4b94c2de tempest-CreateVolumesFromSnapshotTest-168877895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:24:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-072e356e-ed3e-4256-97df-0dab4b94c2de tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:24:49 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-072e356e-ed3e-4256-97df-0dab4b94c2de tempest-CreateVolumesFromSnapshotTest-168877895 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:24:49 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-072e356e-ed3e-4256-97df-0dab4b94c2de tempest-CreateVolumesFromSnapshotTest-168877895 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:24:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-072e356e-ed3e-4256-97df-0dab4b94c2de tempest-CreateVolumesFromSnapshotTest-168877895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-65c727c7-8689-44b6-b721-bdd8582e0c00 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:49 devstack sudo[92466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-65c727c7-8689-44b6-b721-bdd8582e0c00 1073741824 Apr 28 19:24:49 devstack sudo[92466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:50 devstack sudo[92464]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-27a1ca4c-6328-435f-8ed7-7719da5f30db tempest-VolumesSnapshotNegativeTestJSON-920273551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6.5730c383-f597-40c5-b13e-344a65c57364" returned: 0 in 0.750s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-27a1ca4c-6328-435f-8ed7-7719da5f30db tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6.5730c383-f597-40c5-b13e-344a65c57364 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:50 devstack sudo[92474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6.5730c383-f597-40c5-b13e-344a65c57364 Apr 28 19:24:50 devstack sudo[92474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:50 devstack sudo[92466]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-072e356e-ed3e-4256-97df-0dab4b94c2de tempest-CreateVolumesFromSnapshotTest-168877895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-65c727c7-8689-44b6-b721-bdd8582e0c00 1073741824" returned: 0 in 0.869s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-072e356e-ed3e-4256-97df-0dab4b94c2de tempest-CreateVolumesFromSnapshotTest-168877895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-65c727c7-8689-44b6-b721-bdd8582e0c00 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:50 devstack sudo[92476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-65c727c7-8689-44b6-b721-bdd8582e0c00 Apr 28 19:24:50 devstack sudo[92476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:50 devstack sudo[92474]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-27a1ca4c-6328-435f-8ed7-7719da5f30db tempest-VolumesSnapshotNegativeTestJSON-920273551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6.5730c383-f597-40c5-b13e-344a65c57364" returned: 0 in 0.659s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:51 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-27a1ca4c-6328-435f-8ed7-7719da5f30db tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Lock "cinder-quobyte-5730c383-f597-40c5-b13e-344a65c57364" released by "_delete_snapshot" :: held 3.100s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:24:51 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-27a1ca4c-6328-435f-8ed7-7719da5f30db tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Lock "cinder-quobyte-cc9024ef-4052-4c2a-af6f-a25b140e32d6" released by "delete_snapshot" :: held 3.125s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:24:51 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-27a1ca4c-6328-435f-8ed7-7719da5f30db tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Created reservations ['e2108550-e6bb-4364-a652-e86700a853bb', 'be88ef55-8936-4cb3-99dc-61a7b3d1c33c', '4f4b96f9-5f1e-4618-811e-c07f4db14349', '3299daef-7e0e-4db3-ac58-0ec4e8afff77'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:24:51 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-27a1ca4c-6328-435f-8ed7-7719da5f30db tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Delete snapshot completed successfully. Apr 28 19:24:51 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-27a1ca4c-6328-435f-8ed7-7719da5f30db tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Lock "cinder-5730c383-f597-40c5-b13e-344a65c57364-delete_snapshot" released by "delete_snapshot" :: held 3.276s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:24:51 devstack sudo[92476]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-072e356e-ed3e-4256-97df-0dab4b94c2de tempest-CreateVolumesFromSnapshotTest-168877895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-65c727c7-8689-44b6-b721-bdd8582e0c00" returned: 0 in 0.622s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:51 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-072e356e-ed3e-4256-97df-0dab4b94c2de tempest-CreateVolumesFromSnapshotTest-168877895 None] <== create_volume: return (1549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:24:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-072e356e-ed3e-4256-97df-0dab4b94c2de tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:24:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-072e356e-ed3e-4256-97df-0dab4b94c2de tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c75ba951-619a-4a09-bc6b-4905467711cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65c727c7-8689-44b6-b721-bdd8582e0c00', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:24:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-072e356e-ed3e-4256-97df-0dab4b94c2de tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dea51c8-6ce2-4200-b0d5-933947a3d37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:51 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-072e356e-ed3e-4256-97df-0dab4b94c2de tempest-CreateVolumesFromSnapshotTest-168877895 None] Volume volume-65c727c7-8689-44b6-b721-bdd8582e0c00 (65c727c7-8689-44b6-b721-bdd8582e0c00): created successfully Apr 28 19:24:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-072e356e-ed3e-4256-97df-0dab4b94c2de tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dea51c8-6ce2-4200-b0d5-933947a3d37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:24:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-072e356e-ed3e-4256-97df-0dab4b94c2de tempest-CreateVolumesFromSnapshotTest-168877895 None] Flow 'volume_create_manager' (0f6be0ae-5575-431e-b0e7-d166dd2ada16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:24:51 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-072e356e-ed3e-4256-97df-0dab4b94c2de tempest-CreateVolumesFromSnapshotTest-168877895 None] Created volume successfully. Apr 28 19:24:51 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:SELECT=104,cinder:INSERT=33,cinder:UPDATE=125,cinder:DELETE=12 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 19:24:51 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:SELECT=105,cinder:INSERT=36,cinder:UPDATE=135,cinder:DELETE=8 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 19:24:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-adff0325-9b4e-4d6a-8853-25659f7e7d7a tempest-CreateVolumesFromSnapshotTest-168877895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:24:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-adff0325-9b4e-4d6a-8853-25659f7e7d7a tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:24:51 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-adff0325-9b4e-4d6a-8853-25659f7e7d7a tempest-CreateVolumesFromSnapshotTest-168877895 None] Creating offline snapshot 72fb769d-0f47-4932-a8da-b66749024b3e of volume 65c727c7-8689-44b6-b721-bdd8582e0c00 {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 19:24:51 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d649660c-ac44-4400-841d-a2b729cdaf63]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:24:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-adff0325-9b4e-4d6a-8853-25659f7e7d7a tempest-CreateVolumesFromSnapshotTest-168877895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-65c727c7-8689-44b6-b721-bdd8582e0c00 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:51 devstack sudo[92483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-65c727c7-8689-44b6-b721-bdd8582e0c00 Apr 28 19:24:51 devstack sudo[92483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d9cbd308-8bb7-4c87-9d7a-d3d9325b1c86 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Acquiring lock "cinder-cc9024ef-4052-4c2a-af6f-a25b140e32d6-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:24:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d9cbd308-8bb7-4c87-9d7a-d3d9325b1c86 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Lock "cinder-cc9024ef-4052-4c2a-af6f-a25b140e32d6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:24:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d9cbd308-8bb7-4c87-9d7a-d3d9325b1c86 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Acquiring lock "cinder-quobyte-cc9024ef-4052-4c2a-af6f-a25b140e32d6" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:24:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d9cbd308-8bb7-4c87-9d7a-d3d9325b1c86 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Lock "cinder-quobyte-cc9024ef-4052-4c2a-af6f-a25b140e32d6" acquired by "delete_volume" :: waited 0.017s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:24:52 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1933b3-69b8-4e27-a2c4-70bb12c59173]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:24:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d9cbd308-8bb7-4c87-9d7a-d3d9325b1c86 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:52 devstack sudo[92485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6 Apr 28 19:24:52 devstack sudo[92485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:52 devstack sudo[92483]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-adff0325-9b4e-4d6a-8853-25659f7e7d7a tempest-CreateVolumesFromSnapshotTest-168877895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-65c727c7-8689-44b6-b721-bdd8582e0c00" returned: 0 in 0.727s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-adff0325-9b4e-4d6a-8853-25659f7e7d7a tempest-CreateVolumesFromSnapshotTest-168877895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-65c727c7-8689-44b6-b721-bdd8582e0c00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-65c727c7-8689-44b6-b721-bdd8582e0c00.72fb769d-0f47-4932-a8da-b66749024b3e 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:52 devstack sudo[92490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-65c727c7-8689-44b6-b721-bdd8582e0c00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-65c727c7-8689-44b6-b721-bdd8582e0c00.72fb769d-0f47-4932-a8da-b66749024b3e 1G Apr 28 19:24:52 devstack sudo[92490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:52 devstack sudo[92485]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d9cbd308-8bb7-4c87-9d7a-d3d9325b1c86 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6" returned: 0 in 0.736s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d9cbd308-8bb7-4c87-9d7a-d3d9325b1c86 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:53 devstack sudo[92495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6 Apr 28 19:24:53 devstack sudo[92495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:53 devstack sudo[92490]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-adff0325-9b4e-4d6a-8853-25659f7e7d7a tempest-CreateVolumesFromSnapshotTest-168877895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-65c727c7-8689-44b6-b721-bdd8582e0c00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-65c727c7-8689-44b6-b721-bdd8582e0c00.72fb769d-0f47-4932-a8da-b66749024b3e 1G" returned: 0 in 0.773s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-adff0325-9b4e-4d6a-8853-25659f7e7d7a tempest-CreateVolumesFromSnapshotTest-168877895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65c727c7-8689-44b6-b721-bdd8582e0c00 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-65c727c7-8689-44b6-b721-bdd8582e0c00.72fb769d-0f47-4932-a8da-b66749024b3e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:53 devstack sudo[92500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65c727c7-8689-44b6-b721-bdd8582e0c00 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-65c727c7-8689-44b6-b721-bdd8582e0c00.72fb769d-0f47-4932-a8da-b66749024b3e Apr 28 19:24:53 devstack sudo[92500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:53 devstack sudo[92495]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d9cbd308-8bb7-4c87-9d7a-d3d9325b1c86 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-cc9024ef-4052-4c2a-af6f-a25b140e32d6" returned: 0 in 0.617s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:53 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d9cbd308-8bb7-4c87-9d7a-d3d9325b1c86 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Lock "cinder-quobyte-cc9024ef-4052-4c2a-af6f-a25b140e32d6" released by "delete_volume" :: held 1.418s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:24:53 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-d9cbd308-8bb7-4c87-9d7a-d3d9325b1c86 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Created reservations ['b3a91b88-b70c-4f63-b5eb-ebccda7dce89', '6bd543b0-ee25-450f-a698-a5ebb7869c86', 'b19cc4b7-7054-499b-8de5-ac82adf04303', '0f437d35-d5c1-4967-882e-ad541ac1a858'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:24:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d9cbd308-8bb7-4c87-9d7a-d3d9325b1c86 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:24:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d9cbd308-8bb7-4c87-9d7a-d3d9325b1c86 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:24:53 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d9cbd308-8bb7-4c87-9d7a-d3d9325b1c86 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:24:53 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d9cbd308-8bb7-4c87-9d7a-d3d9325b1c86 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:24:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d9cbd308-8bb7-4c87-9d7a-d3d9325b1c86 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:24:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d9cbd308-8bb7-4c87-9d7a-d3d9325b1c86 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:53 devstack sudo[92503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:24:53 devstack sudo[92503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:53 devstack sudo[92500]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-adff0325-9b4e-4d6a-8853-25659f7e7d7a tempest-CreateVolumesFromSnapshotTest-168877895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65c727c7-8689-44b6-b721-bdd8582e0c00 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-65c727c7-8689-44b6-b721-bdd8582e0c00.72fb769d-0f47-4932-a8da-b66749024b3e" returned: 0 in 0.638s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:53 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-adff0325-9b4e-4d6a-8853-25659f7e7d7a tempest-CreateVolumesFromSnapshotTest-168877895 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-65c727c7-8689-44b6-b721-bdd8582e0c00.72fb769d-0f47-4932-a8da-b66749024b3e is being set with open permissions: ugo+rw Apr 28 19:24:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-adff0325-9b4e-4d6a-8853-25659f7e7d7a tempest-CreateVolumesFromSnapshotTest-168877895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-65c727c7-8689-44b6-b721-bdd8582e0c00.72fb769d-0f47-4932-a8da-b66749024b3e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:54 devstack sudo[92508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-65c727c7-8689-44b6-b721-bdd8582e0c00.72fb769d-0f47-4932-a8da-b66749024b3e Apr 28 19:24:54 devstack sudo[92508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:54 devstack sudo[92503]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d9cbd308-8bb7-4c87-9d7a-d3d9325b1c86 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.633s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:54 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-d9cbd308-8bb7-4c87-9d7a-d3d9325b1c86 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:24:54 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-d9cbd308-8bb7-4c87-9d7a-d3d9325b1c86 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Deleted volume successfully. Apr 28 19:24:54 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d9cbd308-8bb7-4c87-9d7a-d3d9325b1c86 tempest-VolumesSnapshotNegativeTestJSON-920273551 None] Lock "cinder-cc9024ef-4052-4c2a-af6f-a25b140e32d6-delete_volume" released by "delete_volume" :: held 2.256s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:24:54 devstack sudo[92508]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-adff0325-9b4e-4d6a-8853-25659f7e7d7a tempest-CreateVolumesFromSnapshotTest-168877895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-65c727c7-8689-44b6-b721-bdd8582e0c00.72fb769d-0f47-4932-a8da-b66749024b3e" returned: 0 in 0.606s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-adff0325-9b4e-4d6a-8853-25659f7e7d7a tempest-CreateVolumesFromSnapshotTest-168877895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-65c727c7-8689-44b6-b721-bdd8582e0c00.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:54 devstack sudo[92512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-65c727c7-8689-44b6-b721-bdd8582e0c00.info Apr 28 19:24:54 devstack sudo[92512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:55 devstack sudo[92512]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-adff0325-9b4e-4d6a-8853-25659f7e7d7a tempest-CreateVolumesFromSnapshotTest-168877895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-65c727c7-8689-44b6-b721-bdd8582e0c00.info" returned: 0 in 0.635s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:55 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-adff0325-9b4e-4d6a-8853-25659f7e7d7a tempest-CreateVolumesFromSnapshotTest-168877895 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-65c727c7-8689-44b6-b721-bdd8582e0c00.info is being set with open permissions: ugo+rw Apr 28 19:24:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-adff0325-9b4e-4d6a-8853-25659f7e7d7a tempest-CreateVolumesFromSnapshotTest-168877895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-65c727c7-8689-44b6-b721-bdd8582e0c00.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:55 devstack sudo[92515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-65c727c7-8689-44b6-b721-bdd8582e0c00.info Apr 28 19:24:55 devstack sudo[92515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:55 devstack sudo[92515]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-adff0325-9b4e-4d6a-8853-25659f7e7d7a tempest-CreateVolumesFromSnapshotTest-168877895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-65c727c7-8689-44b6-b721-bdd8582e0c00.info" returned: 0 in 0.618s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-adff0325-9b4e-4d6a-8853-25659f7e7d7a tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.081s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:24:55 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-adff0325-9b4e-4d6a-8853-25659f7e7d7a tempest-CreateVolumesFromSnapshotTest-168877895 None] Create snapshot completed successfully Apr 28 19:24:57 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-612c5ef9-e9de-4566-8e69-87ea4b977e9a tempest-CreateVolumesFromSnapshotTest-168877895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:24:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-612c5ef9-e9de-4566-8e69-87ea4b977e9a tempest-CreateVolumesFromSnapshotTest-168877895 None] Flow 'volume_create_manager' (b076194b-5d88-4e8a-923a-0a25a23a80b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:24:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-612c5ef9-e9de-4566-8e69-87ea4b977e9a tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd73f86c-39fe-48b5-bcdd-b7e8b558e35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-612c5ef9-e9de-4566-8e69-87ea4b977e9a tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd73f86c-39fe-48b5-bcdd-b7e8b558e35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:24:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1507751815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb56e904-54fb-4bd1-acdd-b43d352deafc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daec59bcd0e540df98e2e349332b2578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:24:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:24:57Z,use_quota=True,user_id='f5bad6057d28482bb7e5f273ee32cd63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:24:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-612c5ef9-e9de-4566-8e69-87ea4b977e9a tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (283e3b58-228d-4c5e-b86c-bbf0943cd860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-612c5ef9-e9de-4566-8e69-87ea4b977e9a tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (283e3b58-228d-4c5e-b86c-bbf0943cd860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:24:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-612c5ef9-e9de-4566-8e69-87ea4b977e9a tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8f69639-26dc-46f8-880f-1e1f935aeb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-612c5ef9-e9de-4566-8e69-87ea4b977e9a tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8f69639-26dc-46f8-880f-1e1f935aeb8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb56e904-54fb-4bd1-acdd-b43d352deafc', 'volume_name': 'volume-eb56e904-54fb-4bd1-acdd-b43d352deafc', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:24:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-612c5ef9-e9de-4566-8e69-87ea4b977e9a tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad367909-6581-4ac3-9c00-38e20d925624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-612c5ef9-e9de-4566-8e69-87ea4b977e9a tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad367909-6581-4ac3-9c00-38e20d925624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:24:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-612c5ef9-e9de-4566-8e69-87ea4b977e9a tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ea4bed2-7aa5-4ebf-a78c-1dcdd2021dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:57 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-612c5ef9-e9de-4566-8e69-87ea4b977e9a tempest-CreateVolumesFromSnapshotTest-168877895 None] Volume eb56e904-54fb-4bd1-acdd-b43d352deafc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb56e904-54fb-4bd1-acdd-b43d352deafc', 'volume_size': 1} Apr 28 19:24:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-612c5ef9-e9de-4566-8e69-87ea4b977e9a tempest-CreateVolumesFromSnapshotTest-168877895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:24:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-612c5ef9-e9de-4566-8e69-87ea4b977e9a tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:24:57 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-612c5ef9-e9de-4566-8e69-87ea4b977e9a tempest-CreateVolumesFromSnapshotTest-168877895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:24:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1507751815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb56e904-54fb-4bd1-acdd-b43d352deafc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daec59bcd0e540df98e2e349332b2578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:24:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:24:57Z,use_quota=True,user_id='f5bad6057d28482bb7e5f273ee32cd63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:24:57 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-612c5ef9-e9de-4566-8e69-87ea4b977e9a tempest-CreateVolumesFromSnapshotTest-168877895 None] Creating volume eb56e904-54fb-4bd1-acdd-b43d352deafc {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:24:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-612c5ef9-e9de-4566-8e69-87ea4b977e9a tempest-CreateVolumesFromSnapshotTest-168877895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:24:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-612c5ef9-e9de-4566-8e69-87ea4b977e9a tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:24:57 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-612c5ef9-e9de-4566-8e69-87ea4b977e9a tempest-CreateVolumesFromSnapshotTest-168877895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:24:57 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-612c5ef9-e9de-4566-8e69-87ea4b977e9a tempest-CreateVolumesFromSnapshotTest-168877895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:24:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-612c5ef9-e9de-4566-8e69-87ea4b977e9a tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:24:57 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-612c5ef9-e9de-4566-8e69-87ea4b977e9a tempest-CreateVolumesFromSnapshotTest-168877895 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:24:57 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-612c5ef9-e9de-4566-8e69-87ea4b977e9a tempest-CreateVolumesFromSnapshotTest-168877895 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:24:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-612c5ef9-e9de-4566-8e69-87ea4b977e9a tempest-CreateVolumesFromSnapshotTest-168877895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-eb56e904-54fb-4bd1-acdd-b43d352deafc 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:57 devstack sudo[92519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-eb56e904-54fb-4bd1-acdd-b43d352deafc 1073741824 Apr 28 19:24:57 devstack sudo[92519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:57 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-31d8b73f-3a24-40f2-95f3-58889e3e041b tempest-CreateVolumesFromSnapshotTest-168877895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:24:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-31d8b73f-3a24-40f2-95f3-58889e3e041b tempest-CreateVolumesFromSnapshotTest-168877895 None] Flow 'volume_create_manager' (c6b4f284-6634-4d30-9511-3349c9ac3619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:24:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-31d8b73f-3a24-40f2-95f3-58889e3e041b tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcc40576-7dca-4e79-9b07-32ad45f88e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-31d8b73f-3a24-40f2-95f3-58889e3e041b tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcc40576-7dca-4e79-9b07-32ad45f88e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-465018453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6f25089-5f3b-43eb-a370-b09826e7f7f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daec59bcd0e540df98e2e349332b2578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:24:58Z,use_quota=True,user_id='f5bad6057d28482bb7e5f273ee32cd63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:24:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-31d8b73f-3a24-40f2-95f3-58889e3e041b tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (107fafa8-d44c-490e-b90f-3d1f7ca933fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-31d8b73f-3a24-40f2-95f3-58889e3e041b tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (107fafa8-d44c-490e-b90f-3d1f7ca933fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:24:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-31d8b73f-3a24-40f2-95f3-58889e3e041b tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9ece184-7cf6-4978-8b76-ebfbdd0be40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-31d8b73f-3a24-40f2-95f3-58889e3e041b tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9ece184-7cf6-4978-8b76-ebfbdd0be40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6f25089-5f3b-43eb-a370-b09826e7f7f0', 'volume_name': 'volume-b6f25089-5f3b-43eb-a370-b09826e7f7f0', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:24:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-31d8b73f-3a24-40f2-95f3-58889e3e041b tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80605c8d-6324-4124-a5b4-bb5e569aa367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-31d8b73f-3a24-40f2-95f3-58889e3e041b tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80605c8d-6324-4124-a5b4-bb5e569aa367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:24:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-31d8b73f-3a24-40f2-95f3-58889e3e041b tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1057f24-801c-440c-8b82-22e422908e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:57 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-31d8b73f-3a24-40f2-95f3-58889e3e041b tempest-CreateVolumesFromSnapshotTest-168877895 None] Volume b6f25089-5f3b-43eb-a370-b09826e7f7f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6f25089-5f3b-43eb-a370-b09826e7f7f0', 'volume_size': 1} Apr 28 19:24:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-31d8b73f-3a24-40f2-95f3-58889e3e041b tempest-CreateVolumesFromSnapshotTest-168877895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:24:58 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-5359d97e-d480-4e03-a65d-e2eccdc2ffe5 tempest-CreateVolumesFromSnapshotTest-168877895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:24:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5359d97e-d480-4e03-a65d-e2eccdc2ffe5 tempest-CreateVolumesFromSnapshotTest-168877895 None] Flow 'volume_create_manager' (ffc958b5-d8f7-46b9-942e-1c8befd12feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:24:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5359d97e-d480-4e03-a65d-e2eccdc2ffe5 tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c58f204-1cfa-49d3-927f-44c86b51c0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5359d97e-d480-4e03-a65d-e2eccdc2ffe5 tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c58f204-1cfa-49d3-927f-44c86b51c0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1062606684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d65d2df5-9fd6-403a-b1e1-507b951237f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daec59bcd0e540df98e2e349332b2578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:24:58Z,use_quota=True,user_id='f5bad6057d28482bb7e5f273ee32cd63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:24:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5359d97e-d480-4e03-a65d-e2eccdc2ffe5 tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b16c3d3d-a144-4de8-a10b-88fcde26b497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5359d97e-d480-4e03-a65d-e2eccdc2ffe5 tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b16c3d3d-a144-4de8-a10b-88fcde26b497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:24:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5359d97e-d480-4e03-a65d-e2eccdc2ffe5 tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeddf043-92ec-4919-9cf7-c2267fd21b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5359d97e-d480-4e03-a65d-e2eccdc2ffe5 tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeddf043-92ec-4919-9cf7-c2267fd21b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd65d2df5-9fd6-403a-b1e1-507b951237f1', 'volume_name': 'volume-d65d2df5-9fd6-403a-b1e1-507b951237f1', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:24:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5359d97e-d480-4e03-a65d-e2eccdc2ffe5 tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9963b2d1-fed7-40b6-8829-ef8486a446fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5359d97e-d480-4e03-a65d-e2eccdc2ffe5 tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9963b2d1-fed7-40b6-8829-ef8486a446fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:24:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5359d97e-d480-4e03-a65d-e2eccdc2ffe5 tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9de5c99a-4cd3-4808-bbdf-f305179263fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:58 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-5359d97e-d480-4e03-a65d-e2eccdc2ffe5 tempest-CreateVolumesFromSnapshotTest-168877895 None] Volume d65d2df5-9fd6-403a-b1e1-507b951237f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d65d2df5-9fd6-403a-b1e1-507b951237f1', 'volume_size': 1} Apr 28 19:24:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5359d97e-d480-4e03-a65d-e2eccdc2ffe5 tempest-CreateVolumesFromSnapshotTest-168877895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:24:58 devstack sudo[92519]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-612c5ef9-e9de-4566-8e69-87ea4b977e9a tempest-CreateVolumesFromSnapshotTest-168877895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-eb56e904-54fb-4bd1-acdd-b43d352deafc 1073741824" returned: 0 in 1.062s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-612c5ef9-e9de-4566-8e69-87ea4b977e9a tempest-CreateVolumesFromSnapshotTest-168877895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-eb56e904-54fb-4bd1-acdd-b43d352deafc {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:58 devstack sudo[92525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-eb56e904-54fb-4bd1-acdd-b43d352deafc Apr 28 19:24:58 devstack sudo[92525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:58 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-871ccbd8-8574-4d32-ac98-a81c2f995663 tempest-CreateVolumesFromSnapshotTest-168877895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:24:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-871ccbd8-8574-4d32-ac98-a81c2f995663 tempest-CreateVolumesFromSnapshotTest-168877895 None] Flow 'volume_create_manager' (8fecaaa9-05d8-42e2-a44e-4fd6524b8a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:24:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-871ccbd8-8574-4d32-ac98-a81c2f995663 tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83f85af9-9d11-48c1-969f-b0c66e65de15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-871ccbd8-8574-4d32-ac98-a81c2f995663 tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83f85af9-9d11-48c1-969f-b0c66e65de15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-779765228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89a6a8d5-990d-464c-81c6-8cb7b1afd30e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daec59bcd0e540df98e2e349332b2578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:24:59Z,use_quota=True,user_id='f5bad6057d28482bb7e5f273ee32cd63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:24:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-871ccbd8-8574-4d32-ac98-a81c2f995663 tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e8993bd-44b9-4d2c-bba1-95d7ca5d164d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-871ccbd8-8574-4d32-ac98-a81c2f995663 tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e8993bd-44b9-4d2c-bba1-95d7ca5d164d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:24:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-871ccbd8-8574-4d32-ac98-a81c2f995663 tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c70040fb-69be-443f-a0e8-bfcb46fdca74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-871ccbd8-8574-4d32-ac98-a81c2f995663 tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c70040fb-69be-443f-a0e8-bfcb46fdca74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89a6a8d5-990d-464c-81c6-8cb7b1afd30e', 'volume_name': 'volume-89a6a8d5-990d-464c-81c6-8cb7b1afd30e', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:24:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-871ccbd8-8574-4d32-ac98-a81c2f995663 tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8279f502-627a-413b-9b2b-564cf3acccd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-871ccbd8-8574-4d32-ac98-a81c2f995663 tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8279f502-627a-413b-9b2b-564cf3acccd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:24:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-871ccbd8-8574-4d32-ac98-a81c2f995663 tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff2e3039-df2c-4e5a-97cd-d5300786e5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:58 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-871ccbd8-8574-4d32-ac98-a81c2f995663 tempest-CreateVolumesFromSnapshotTest-168877895 None] Volume 89a6a8d5-990d-464c-81c6-8cb7b1afd30e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89a6a8d5-990d-464c-81c6-8cb7b1afd30e', 'volume_size': 1} Apr 28 19:24:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-871ccbd8-8574-4d32-ac98-a81c2f995663 tempest-CreateVolumesFromSnapshotTest-168877895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:24:59 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5faea18-c253-41d1-8abc-1d98c36497e6 tempest-CreateVolumesFromSnapshotTest-168877895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:24:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5faea18-c253-41d1-8abc-1d98c36497e6 tempest-CreateVolumesFromSnapshotTest-168877895 None] Flow 'volume_create_manager' (f96ebdb9-18ca-4ea9-af8e-67e8c0cda727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:24:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5faea18-c253-41d1-8abc-1d98c36497e6 tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06fb296c-d0ca-46f2-9006-0d235f7086d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5faea18-c253-41d1-8abc-1d98c36497e6 tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06fb296c-d0ca-46f2-9006-0d235f7086d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-523438601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2da37fd0-e1ae-4056-be7f-adbe4cfc220e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daec59bcd0e540df98e2e349332b2578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:24:59Z,use_quota=True,user_id='f5bad6057d28482bb7e5f273ee32cd63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:24:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5faea18-c253-41d1-8abc-1d98c36497e6 tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (395c337c-ac03-4576-9041-55738ed4b812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5faea18-c253-41d1-8abc-1d98c36497e6 tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (395c337c-ac03-4576-9041-55738ed4b812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:24:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5faea18-c253-41d1-8abc-1d98c36497e6 tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aea61662-d984-4988-adca-92e280da4b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5faea18-c253-41d1-8abc-1d98c36497e6 tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aea61662-d984-4988-adca-92e280da4b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2da37fd0-e1ae-4056-be7f-adbe4cfc220e', 'volume_name': 'volume-2da37fd0-e1ae-4056-be7f-adbe4cfc220e', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:24:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5faea18-c253-41d1-8abc-1d98c36497e6 tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (459ac764-b6e3-4044-bd05-551da8d79168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5faea18-c253-41d1-8abc-1d98c36497e6 tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (459ac764-b6e3-4044-bd05-551da8d79168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:24:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5faea18-c253-41d1-8abc-1d98c36497e6 tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da107a79-ee92-4b59-bb0f-9955d5c3c24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:59 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-a5faea18-c253-41d1-8abc-1d98c36497e6 tempest-CreateVolumesFromSnapshotTest-168877895 None] Volume 2da37fd0-e1ae-4056-be7f-adbe4cfc220e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2da37fd0-e1ae-4056-be7f-adbe4cfc220e', 'volume_size': 1} Apr 28 19:24:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a5faea18-c253-41d1-8abc-1d98c36497e6 tempest-CreateVolumesFromSnapshotTest-168877895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:24:59 devstack sudo[92525]: pam_unix(sudo:session): session closed for user root Apr 28 19:24:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-612c5ef9-e9de-4566-8e69-87ea4b977e9a tempest-CreateVolumesFromSnapshotTest-168877895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-eb56e904-54fb-4bd1-acdd-b43d352deafc" returned: 0 in 0.787s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:24:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-612c5ef9-e9de-4566-8e69-87ea4b977e9a tempest-CreateVolumesFromSnapshotTest-168877895 None] <== create_volume: return (1916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:24:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-612c5ef9-e9de-4566-8e69-87ea4b977e9a tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.918s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:24:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-31d8b73f-3a24-40f2-95f3-58889e3e041b tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.473s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:24:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-31d8b73f-3a24-40f2-95f3-58889e3e041b tempest-CreateVolumesFromSnapshotTest-168877895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-465018453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6f25089-5f3b-43eb-a370-b09826e7f7f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daec59bcd0e540df98e2e349332b2578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:24:58Z,use_quota=True,user_id='f5bad6057d28482bb7e5f273ee32cd63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:24:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-31d8b73f-3a24-40f2-95f3-58889e3e041b tempest-CreateVolumesFromSnapshotTest-168877895 None] Creating volume b6f25089-5f3b-43eb-a370-b09826e7f7f0 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:24:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-31d8b73f-3a24-40f2-95f3-58889e3e041b tempest-CreateVolumesFromSnapshotTest-168877895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:24:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-31d8b73f-3a24-40f2-95f3-58889e3e041b tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:24:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-31d8b73f-3a24-40f2-95f3-58889e3e041b tempest-CreateVolumesFromSnapshotTest-168877895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:24:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-31d8b73f-3a24-40f2-95f3-58889e3e041b tempest-CreateVolumesFromSnapshotTest-168877895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:24:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-31d8b73f-3a24-40f2-95f3-58889e3e041b tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:24:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-31d8b73f-3a24-40f2-95f3-58889e3e041b tempest-CreateVolumesFromSnapshotTest-168877895 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:24:59 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-31d8b73f-3a24-40f2-95f3-58889e3e041b tempest-CreateVolumesFromSnapshotTest-168877895 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:24:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-31d8b73f-3a24-40f2-95f3-58889e3e041b tempest-CreateVolumesFromSnapshotTest-168877895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b6f25089-5f3b-43eb-a370-b09826e7f7f0 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:24:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-612c5ef9-e9de-4566-8e69-87ea4b977e9a tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ea4bed2-7aa5-4ebf-a78c-1dcdd2021dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb56e904-54fb-4bd1-acdd-b43d352deafc', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:24:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-612c5ef9-e9de-4566-8e69-87ea4b977e9a tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90f81e51-9c22-4f57-ac4f-62541c5d0544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:24:59 devstack sudo[92528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b6f25089-5f3b-43eb-a370-b09826e7f7f0 1073741824 Apr 28 19:24:59 devstack sudo[92528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:24:59 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-612c5ef9-e9de-4566-8e69-87ea4b977e9a tempest-CreateVolumesFromSnapshotTest-168877895 None] Volume volume-eb56e904-54fb-4bd1-acdd-b43d352deafc (eb56e904-54fb-4bd1-acdd-b43d352deafc): created successfully Apr 28 19:24:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-612c5ef9-e9de-4566-8e69-87ea4b977e9a tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90f81e51-9c22-4f57-ac4f-62541c5d0544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:24:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-612c5ef9-e9de-4566-8e69-87ea4b977e9a tempest-CreateVolumesFromSnapshotTest-168877895 None] Flow 'volume_create_manager' (b076194b-5d88-4e8a-923a-0a25a23a80b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:24:59 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-612c5ef9-e9de-4566-8e69-87ea4b977e9a tempest-CreateVolumesFromSnapshotTest-168877895 None] Created volume successfully. Apr 28 19:25:00 devstack sudo[92528]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-31d8b73f-3a24-40f2-95f3-58889e3e041b tempest-CreateVolumesFromSnapshotTest-168877895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b6f25089-5f3b-43eb-a370-b09826e7f7f0 1073741824" returned: 0 in 0.863s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-31d8b73f-3a24-40f2-95f3-58889e3e041b tempest-CreateVolumesFromSnapshotTest-168877895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b6f25089-5f3b-43eb-a370-b09826e7f7f0 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:00 devstack sudo[92534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b6f25089-5f3b-43eb-a370-b09826e7f7f0 Apr 28 19:25:00 devstack sudo[92534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:00 devstack sudo[92534]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-31d8b73f-3a24-40f2-95f3-58889e3e041b tempest-CreateVolumesFromSnapshotTest-168877895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b6f25089-5f3b-43eb-a370-b09826e7f7f0" returned: 0 in 0.609s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-31d8b73f-3a24-40f2-95f3-58889e3e041b tempest-CreateVolumesFromSnapshotTest-168877895 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:25:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-31d8b73f-3a24-40f2-95f3-58889e3e041b tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:25:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5359d97e-d480-4e03-a65d-e2eccdc2ffe5 tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.538s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:25:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5359d97e-d480-4e03-a65d-e2eccdc2ffe5 tempest-CreateVolumesFromSnapshotTest-168877895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1062606684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d65d2df5-9fd6-403a-b1e1-507b951237f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daec59bcd0e540df98e2e349332b2578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:24:58Z,use_quota=True,user_id='f5bad6057d28482bb7e5f273ee32cd63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:25:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-5359d97e-d480-4e03-a65d-e2eccdc2ffe5 tempest-CreateVolumesFromSnapshotTest-168877895 None] Creating volume d65d2df5-9fd6-403a-b1e1-507b951237f1 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:25:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5359d97e-d480-4e03-a65d-e2eccdc2ffe5 tempest-CreateVolumesFromSnapshotTest-168877895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:25:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5359d97e-d480-4e03-a65d-e2eccdc2ffe5 tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:25:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5359d97e-d480-4e03-a65d-e2eccdc2ffe5 tempest-CreateVolumesFromSnapshotTest-168877895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:25:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5359d97e-d480-4e03-a65d-e2eccdc2ffe5 tempest-CreateVolumesFromSnapshotTest-168877895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:25:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5359d97e-d480-4e03-a65d-e2eccdc2ffe5 tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:25:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5359d97e-d480-4e03-a65d-e2eccdc2ffe5 tempest-CreateVolumesFromSnapshotTest-168877895 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:25:00 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-5359d97e-d480-4e03-a65d-e2eccdc2ffe5 tempest-CreateVolumesFromSnapshotTest-168877895 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:25:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5359d97e-d480-4e03-a65d-e2eccdc2ffe5 tempest-CreateVolumesFromSnapshotTest-168877895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d65d2df5-9fd6-403a-b1e1-507b951237f1 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:01 devstack sudo[92538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d65d2df5-9fd6-403a-b1e1-507b951237f1 1073741824 Apr 28 19:25:01 devstack sudo[92538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-31d8b73f-3a24-40f2-95f3-58889e3e041b tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1057f24-801c-440c-8b82-22e422908e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6f25089-5f3b-43eb-a370-b09826e7f7f0', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:25:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-31d8b73f-3a24-40f2-95f3-58889e3e041b tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89037f4d-f0de-4669-af44-c83200b8ae15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:25:01 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-31d8b73f-3a24-40f2-95f3-58889e3e041b tempest-CreateVolumesFromSnapshotTest-168877895 None] Volume volume-b6f25089-5f3b-43eb-a370-b09826e7f7f0 (b6f25089-5f3b-43eb-a370-b09826e7f7f0): created successfully Apr 28 19:25:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-31d8b73f-3a24-40f2-95f3-58889e3e041b tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89037f4d-f0de-4669-af44-c83200b8ae15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:25:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-31d8b73f-3a24-40f2-95f3-58889e3e041b tempest-CreateVolumesFromSnapshotTest-168877895 None] Flow 'volume_create_manager' (c6b4f284-6634-4d30-9511-3349c9ac3619) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:25:01 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-31d8b73f-3a24-40f2-95f3-58889e3e041b tempest-CreateVolumesFromSnapshotTest-168877895 None] Created volume successfully. Apr 28 19:25:01 devstack sudo[92538]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5359d97e-d480-4e03-a65d-e2eccdc2ffe5 tempest-CreateVolumesFromSnapshotTest-168877895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d65d2df5-9fd6-403a-b1e1-507b951237f1 1073741824" returned: 0 in 0.953s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5359d97e-d480-4e03-a65d-e2eccdc2ffe5 tempest-CreateVolumesFromSnapshotTest-168877895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d65d2df5-9fd6-403a-b1e1-507b951237f1 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:02 devstack sudo[92547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d65d2df5-9fd6-403a-b1e1-507b951237f1 Apr 28 19:25:02 devstack sudo[92547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:02 devstack sudo[92547]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5359d97e-d480-4e03-a65d-e2eccdc2ffe5 tempest-CreateVolumesFromSnapshotTest-168877895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d65d2df5-9fd6-403a-b1e1-507b951237f1" returned: 0 in 0.704s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:02 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5359d97e-d480-4e03-a65d-e2eccdc2ffe5 tempest-CreateVolumesFromSnapshotTest-168877895 None] <== create_volume: return (1711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:25:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5359d97e-d480-4e03-a65d-e2eccdc2ffe5 tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.715s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:25:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-871ccbd8-8574-4d32-ac98-a81c2f995663 tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.778s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:25:02 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-871ccbd8-8574-4d32-ac98-a81c2f995663 tempest-CreateVolumesFromSnapshotTest-168877895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-779765228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89a6a8d5-990d-464c-81c6-8cb7b1afd30e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daec59bcd0e540df98e2e349332b2578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:24:59Z,use_quota=True,user_id='f5bad6057d28482bb7e5f273ee32cd63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:25:02 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-871ccbd8-8574-4d32-ac98-a81c2f995663 tempest-CreateVolumesFromSnapshotTest-168877895 None] Creating volume 89a6a8d5-990d-464c-81c6-8cb7b1afd30e {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:25:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-871ccbd8-8574-4d32-ac98-a81c2f995663 tempest-CreateVolumesFromSnapshotTest-168877895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:25:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-871ccbd8-8574-4d32-ac98-a81c2f995663 tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:25:02 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-871ccbd8-8574-4d32-ac98-a81c2f995663 tempest-CreateVolumesFromSnapshotTest-168877895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:25:02 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-871ccbd8-8574-4d32-ac98-a81c2f995663 tempest-CreateVolumesFromSnapshotTest-168877895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:25:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-871ccbd8-8574-4d32-ac98-a81c2f995663 tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:25:02 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-871ccbd8-8574-4d32-ac98-a81c2f995663 tempest-CreateVolumesFromSnapshotTest-168877895 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:25:02 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-871ccbd8-8574-4d32-ac98-a81c2f995663 tempest-CreateVolumesFromSnapshotTest-168877895 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:25:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-871ccbd8-8574-4d32-ac98-a81c2f995663 tempest-CreateVolumesFromSnapshotTest-168877895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-89a6a8d5-990d-464c-81c6-8cb7b1afd30e 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:02 devstack sudo[92550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-89a6a8d5-990d-464c-81c6-8cb7b1afd30e 1073741824 Apr 28 19:25:02 devstack sudo[92550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5359d97e-d480-4e03-a65d-e2eccdc2ffe5 tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9de5c99a-4cd3-4808-bbdf-f305179263fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d65d2df5-9fd6-403a-b1e1-507b951237f1', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:25:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5359d97e-d480-4e03-a65d-e2eccdc2ffe5 tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (535fe76e-5a2a-4952-8ec7-9e0ffd5f3225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:25:02 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-5359d97e-d480-4e03-a65d-e2eccdc2ffe5 tempest-CreateVolumesFromSnapshotTest-168877895 None] Volume volume-d65d2df5-9fd6-403a-b1e1-507b951237f1 (d65d2df5-9fd6-403a-b1e1-507b951237f1): created successfully Apr 28 19:25:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5359d97e-d480-4e03-a65d-e2eccdc2ffe5 tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (535fe76e-5a2a-4952-8ec7-9e0ffd5f3225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:25:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5359d97e-d480-4e03-a65d-e2eccdc2ffe5 tempest-CreateVolumesFromSnapshotTest-168877895 None] Flow 'volume_create_manager' (ffc958b5-d8f7-46b9-942e-1c8befd12feb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:25:02 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-5359d97e-d480-4e03-a65d-e2eccdc2ffe5 tempest-CreateVolumesFromSnapshotTest-168877895 None] Created volume successfully. Apr 28 19:25:03 devstack cinder-volume[83863]: DEBUG oslo_service.periodic_task [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 28 19:25:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:25:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:25:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:25:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:25:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:25:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:03 devstack sudo[92556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:25:03 devstack sudo[92556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:03 devstack sudo[92550]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-871ccbd8-8574-4d32-ac98-a81c2f995663 tempest-CreateVolumesFromSnapshotTest-168877895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-89a6a8d5-990d-464c-81c6-8cb7b1afd30e 1073741824" returned: 0 in 0.901s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-871ccbd8-8574-4d32-ac98-a81c2f995663 tempest-CreateVolumesFromSnapshotTest-168877895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-89a6a8d5-990d-464c-81c6-8cb7b1afd30e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:03 devstack sudo[92558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-89a6a8d5-990d-464c-81c6-8cb7b1afd30e Apr 28 19:25:03 devstack sudo[92558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:04 devstack sudo[92556]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.867s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:04 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:25:04 devstack sudo[92558]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-871ccbd8-8574-4d32-ac98-a81c2f995663 tempest-CreateVolumesFromSnapshotTest-168877895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-89a6a8d5-990d-464c-81c6-8cb7b1afd30e" returned: 0 in 0.733s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:04 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-871ccbd8-8574-4d32-ac98-a81c2f995663 tempest-CreateVolumesFromSnapshotTest-168877895 None] <== create_volume: return (1691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:25:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-871ccbd8-8574-4d32-ac98-a81c2f995663 tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.694s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:25:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a5faea18-c253-41d1-8abc-1d98c36497e6 tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.103s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:25:04 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a5faea18-c253-41d1-8abc-1d98c36497e6 tempest-CreateVolumesFromSnapshotTest-168877895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-523438601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2da37fd0-e1ae-4056-be7f-adbe4cfc220e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daec59bcd0e540df98e2e349332b2578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:24:59Z,use_quota=True,user_id='f5bad6057d28482bb7e5f273ee32cd63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:25:04 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-a5faea18-c253-41d1-8abc-1d98c36497e6 tempest-CreateVolumesFromSnapshotTest-168877895 None] Creating volume 2da37fd0-e1ae-4056-be7f-adbe4cfc220e {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:25:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a5faea18-c253-41d1-8abc-1d98c36497e6 tempest-CreateVolumesFromSnapshotTest-168877895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:25:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a5faea18-c253-41d1-8abc-1d98c36497e6 tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:25:04 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a5faea18-c253-41d1-8abc-1d98c36497e6 tempest-CreateVolumesFromSnapshotTest-168877895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:25:04 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a5faea18-c253-41d1-8abc-1d98c36497e6 tempest-CreateVolumesFromSnapshotTest-168877895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:25:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a5faea18-c253-41d1-8abc-1d98c36497e6 tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:25:04 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a5faea18-c253-41d1-8abc-1d98c36497e6 tempest-CreateVolumesFromSnapshotTest-168877895 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:25:04 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-a5faea18-c253-41d1-8abc-1d98c36497e6 tempest-CreateVolumesFromSnapshotTest-168877895 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:25:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a5faea18-c253-41d1-8abc-1d98c36497e6 tempest-CreateVolumesFromSnapshotTest-168877895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2da37fd0-e1ae-4056-be7f-adbe4cfc220e 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-871ccbd8-8574-4d32-ac98-a81c2f995663 tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff2e3039-df2c-4e5a-97cd-d5300786e5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89a6a8d5-990d-464c-81c6-8cb7b1afd30e', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:25:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-871ccbd8-8574-4d32-ac98-a81c2f995663 tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baba6fde-e12d-4403-bfb0-569380dda96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:25:04 devstack sudo[92669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2da37fd0-e1ae-4056-be7f-adbe4cfc220e 1073741824 Apr 28 19:25:04 devstack sudo[92669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:04 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-871ccbd8-8574-4d32-ac98-a81c2f995663 tempest-CreateVolumesFromSnapshotTest-168877895 None] Volume volume-89a6a8d5-990d-464c-81c6-8cb7b1afd30e (89a6a8d5-990d-464c-81c6-8cb7b1afd30e): created successfully Apr 28 19:25:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-871ccbd8-8574-4d32-ac98-a81c2f995663 tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baba6fde-e12d-4403-bfb0-569380dda96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:25:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-871ccbd8-8574-4d32-ac98-a81c2f995663 tempest-CreateVolumesFromSnapshotTest-168877895 None] Flow 'volume_create_manager' (8fecaaa9-05d8-42e2-a44e-4fd6524b8a3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:25:04 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-871ccbd8-8574-4d32-ac98-a81c2f995663 tempest-CreateVolumesFromSnapshotTest-168877895 None] Created volume successfully. Apr 28 19:25:05 devstack sudo[92669]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a5faea18-c253-41d1-8abc-1d98c36497e6 tempest-CreateVolumesFromSnapshotTest-168877895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2da37fd0-e1ae-4056-be7f-adbe4cfc220e 1073741824" returned: 0 in 0.969s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a5faea18-c253-41d1-8abc-1d98c36497e6 tempest-CreateVolumesFromSnapshotTest-168877895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2da37fd0-e1ae-4056-be7f-adbe4cfc220e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:05 devstack sudo[92897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2da37fd0-e1ae-4056-be7f-adbe4cfc220e Apr 28 19:25:05 devstack sudo[92897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:06 devstack sudo[92897]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a5faea18-c253-41d1-8abc-1d98c36497e6 tempest-CreateVolumesFromSnapshotTest-168877895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2da37fd0-e1ae-4056-be7f-adbe4cfc220e" returned: 0 in 0.669s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:06 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a5faea18-c253-41d1-8abc-1d98c36497e6 tempest-CreateVolumesFromSnapshotTest-168877895 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:25:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a5faea18-c253-41d1-8abc-1d98c36497e6 tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.678s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:25:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5faea18-c253-41d1-8abc-1d98c36497e6 tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da107a79-ee92-4b59-bb0f-9955d5c3c24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2da37fd0-e1ae-4056-be7f-adbe4cfc220e', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:25:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5faea18-c253-41d1-8abc-1d98c36497e6 tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ee298a9-47c8-4338-8395-84c7493e278f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:25:06 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-a5faea18-c253-41d1-8abc-1d98c36497e6 tempest-CreateVolumesFromSnapshotTest-168877895 None] Volume volume-2da37fd0-e1ae-4056-be7f-adbe4cfc220e (2da37fd0-e1ae-4056-be7f-adbe4cfc220e): created successfully Apr 28 19:25:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5faea18-c253-41d1-8abc-1d98c36497e6 tempest-CreateVolumesFromSnapshotTest-168877895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ee298a9-47c8-4338-8395-84c7493e278f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:25:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5faea18-c253-41d1-8abc-1d98c36497e6 tempest-CreateVolumesFromSnapshotTest-168877895 None] Flow 'volume_create_manager' (f96ebdb9-18ca-4ea9-af8e-67e8c0cda727) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:25:06 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-a5faea18-c253-41d1-8abc-1d98c36497e6 tempest-CreateVolumesFromSnapshotTest-168877895 None] Created volume successfully. Apr 28 19:25:07 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2f1b1118-7ecf-467c-b785-af29f7dee384 tempest-CreateVolumesFromSnapshotTest-168877895 None] Acquiring lock "cinder-2da37fd0-e1ae-4056-be7f-adbe4cfc220e-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:25:07 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2f1b1118-7ecf-467c-b785-af29f7dee384 tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "cinder-2da37fd0-e1ae-4056-be7f-adbe4cfc220e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:25:07 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2f1b1118-7ecf-467c-b785-af29f7dee384 tempest-CreateVolumesFromSnapshotTest-168877895 None] Acquiring lock "cinder-quobyte-2da37fd0-e1ae-4056-be7f-adbe4cfc220e" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:25:07 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2f1b1118-7ecf-467c-b785-af29f7dee384 tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "cinder-quobyte-2da37fd0-e1ae-4056-be7f-adbe4cfc220e" acquired by "delete_volume" :: waited 0.018s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:25:07 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a244b782-d80d-42b7-9832-e452e5c0eaab]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:25:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2f1b1118-7ecf-467c-b785-af29f7dee384 tempest-CreateVolumesFromSnapshotTest-168877895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2da37fd0-e1ae-4056-be7f-adbe4cfc220e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:07 devstack sudo[92900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2da37fd0-e1ae-4056-be7f-adbe4cfc220e Apr 28 19:25:07 devstack sudo[92900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:07 devstack sudo[92900]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2f1b1118-7ecf-467c-b785-af29f7dee384 tempest-CreateVolumesFromSnapshotTest-168877895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2da37fd0-e1ae-4056-be7f-adbe4cfc220e" returned: 0 in 0.736s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2f1b1118-7ecf-467c-b785-af29f7dee384 tempest-CreateVolumesFromSnapshotTest-168877895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2da37fd0-e1ae-4056-be7f-adbe4cfc220e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:07 devstack sudo[92905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2da37fd0-e1ae-4056-be7f-adbe4cfc220e Apr 28 19:25:07 devstack sudo[92905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:08 devstack sudo[92905]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2f1b1118-7ecf-467c-b785-af29f7dee384 tempest-CreateVolumesFromSnapshotTest-168877895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2da37fd0-e1ae-4056-be7f-adbe4cfc220e" returned: 0 in 0.590s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:08 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2f1b1118-7ecf-467c-b785-af29f7dee384 tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "cinder-quobyte-2da37fd0-e1ae-4056-be7f-adbe4cfc220e" released by "delete_volume" :: held 1.374s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:25:08 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-2f1b1118-7ecf-467c-b785-af29f7dee384 tempest-CreateVolumesFromSnapshotTest-168877895 None] Created reservations ['15d84409-6e72-44b6-9ecd-3aafdfdbc035', '0aaced5c-06c9-448c-b0bf-07695b0384d6', '28dc3bcb-decc-4e31-82b1-ab70bcc0c467', 'ab5dd38a-0abb-4b50-804b-e2af1941043a'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:25:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2f1b1118-7ecf-467c-b785-af29f7dee384 tempest-CreateVolumesFromSnapshotTest-168877895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:25:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2f1b1118-7ecf-467c-b785-af29f7dee384 tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:25:08 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2f1b1118-7ecf-467c-b785-af29f7dee384 tempest-CreateVolumesFromSnapshotTest-168877895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:25:08 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2f1b1118-7ecf-467c-b785-af29f7dee384 tempest-CreateVolumesFromSnapshotTest-168877895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:25:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2f1b1118-7ecf-467c-b785-af29f7dee384 tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:25:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2f1b1118-7ecf-467c-b785-af29f7dee384 tempest-CreateVolumesFromSnapshotTest-168877895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:08 devstack sudo[92908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:25:08 devstack sudo[92908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:09 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c1df343f-8985-49d5-b906-e8d19ffc2bfe tempest-CreateVolumesFromSnapshotTest-168877895 None] Acquiring lock "cinder-89a6a8d5-990d-464c-81c6-8cb7b1afd30e-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:25:09 devstack sudo[92908]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:09 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c1df343f-8985-49d5-b906-e8d19ffc2bfe tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "cinder-89a6a8d5-990d-464c-81c6-8cb7b1afd30e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:25:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2f1b1118-7ecf-467c-b785-af29f7dee384 tempest-CreateVolumesFromSnapshotTest-168877895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.684s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:09 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-2f1b1118-7ecf-467c-b785-af29f7dee384 tempest-CreateVolumesFromSnapshotTest-168877895 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:25:09 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-2f1b1118-7ecf-467c-b785-af29f7dee384 tempest-CreateVolumesFromSnapshotTest-168877895 None] Deleted volume successfully. Apr 28 19:25:09 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2f1b1118-7ecf-467c-b785-af29f7dee384 tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "cinder-2da37fd0-e1ae-4056-be7f-adbe4cfc220e-delete_volume" released by "delete_volume" :: held 2.289s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:25:09 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c1df343f-8985-49d5-b906-e8d19ffc2bfe tempest-CreateVolumesFromSnapshotTest-168877895 None] Acquiring lock "cinder-quobyte-89a6a8d5-990d-464c-81c6-8cb7b1afd30e" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:25:09 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c1df343f-8985-49d5-b906-e8d19ffc2bfe tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "cinder-quobyte-89a6a8d5-990d-464c-81c6-8cb7b1afd30e" acquired by "delete_volume" :: waited 0.014s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:25:09 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1356b6-d712-44a2-8b3e-0cde55f4d052]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:25:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c1df343f-8985-49d5-b906-e8d19ffc2bfe tempest-CreateVolumesFromSnapshotTest-168877895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-89a6a8d5-990d-464c-81c6-8cb7b1afd30e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:09 devstack sudo[92911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-89a6a8d5-990d-464c-81c6-8cb7b1afd30e Apr 28 19:25:09 devstack sudo[92911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:10 devstack sudo[92911]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c1df343f-8985-49d5-b906-e8d19ffc2bfe tempest-CreateVolumesFromSnapshotTest-168877895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-89a6a8d5-990d-464c-81c6-8cb7b1afd30e" returned: 0 in 0.747s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c1df343f-8985-49d5-b906-e8d19ffc2bfe tempest-CreateVolumesFromSnapshotTest-168877895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-89a6a8d5-990d-464c-81c6-8cb7b1afd30e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:10 devstack sudo[92916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-89a6a8d5-990d-464c-81c6-8cb7b1afd30e Apr 28 19:25:10 devstack sudo[92916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:10 devstack sudo[92916]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c1df343f-8985-49d5-b906-e8d19ffc2bfe tempest-CreateVolumesFromSnapshotTest-168877895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-89a6a8d5-990d-464c-81c6-8cb7b1afd30e" returned: 0 in 0.735s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:10 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c1df343f-8985-49d5-b906-e8d19ffc2bfe tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "cinder-quobyte-89a6a8d5-990d-464c-81c6-8cb7b1afd30e" released by "delete_volume" :: held 1.533s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:25:10 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-c1df343f-8985-49d5-b906-e8d19ffc2bfe tempest-CreateVolumesFromSnapshotTest-168877895 None] Created reservations ['1436001b-3e25-4e03-8597-24c5f9efa2f8', '1cfd9884-756f-4964-979f-9c2ac645ebda', 'b8e1afdb-4b36-44cc-95e1-88ad059085d2', 'b9d4d42d-c4fa-415c-a3a8-e1c28cf87ee1'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:25:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c1df343f-8985-49d5-b906-e8d19ffc2bfe tempest-CreateVolumesFromSnapshotTest-168877895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:25:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c1df343f-8985-49d5-b906-e8d19ffc2bfe tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:25:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c1df343f-8985-49d5-b906-e8d19ffc2bfe tempest-CreateVolumesFromSnapshotTest-168877895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:25:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c1df343f-8985-49d5-b906-e8d19ffc2bfe tempest-CreateVolumesFromSnapshotTest-168877895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:25:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c1df343f-8985-49d5-b906-e8d19ffc2bfe tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:25:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c1df343f-8985-49d5-b906-e8d19ffc2bfe tempest-CreateVolumesFromSnapshotTest-168877895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:11 devstack sudo[92920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:25:11 devstack sudo[92920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:11 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7e1783cc-72ab-4084-a300-08a207912d3a tempest-CreateVolumesFromSnapshotTest-168877895 None] Acquiring lock "cinder-d65d2df5-9fd6-403a-b1e1-507b951237f1-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:25:11 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7e1783cc-72ab-4084-a300-08a207912d3a tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "cinder-d65d2df5-9fd6-403a-b1e1-507b951237f1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:25:11 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7e1783cc-72ab-4084-a300-08a207912d3a tempest-CreateVolumesFromSnapshotTest-168877895 None] Acquiring lock "cinder-quobyte-d65d2df5-9fd6-403a-b1e1-507b951237f1" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:25:11 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7e1783cc-72ab-4084-a300-08a207912d3a tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "cinder-quobyte-d65d2df5-9fd6-403a-b1e1-507b951237f1" acquired by "delete_volume" :: waited 0.017s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:25:11 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7005c59-5e68-4ad3-bc68-954cf4c253e0]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:25:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7e1783cc-72ab-4084-a300-08a207912d3a tempest-CreateVolumesFromSnapshotTest-168877895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d65d2df5-9fd6-403a-b1e1-507b951237f1 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:11 devstack sudo[92920]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c1df343f-8985-49d5-b906-e8d19ffc2bfe tempest-CreateVolumesFromSnapshotTest-168877895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.694s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:11 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-c1df343f-8985-49d5-b906-e8d19ffc2bfe tempest-CreateVolumesFromSnapshotTest-168877895 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:25:11 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-c1df343f-8985-49d5-b906-e8d19ffc2bfe tempest-CreateVolumesFromSnapshotTest-168877895 None] Deleted volume successfully. Apr 28 19:25:11 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c1df343f-8985-49d5-b906-e8d19ffc2bfe tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "cinder-89a6a8d5-990d-464c-81c6-8cb7b1afd30e-delete_volume" released by "delete_volume" :: held 2.448s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:25:11 devstack sudo[92923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d65d2df5-9fd6-403a-b1e1-507b951237f1 Apr 28 19:25:11 devstack sudo[92923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:12 devstack sudo[92923]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7e1783cc-72ab-4084-a300-08a207912d3a tempest-CreateVolumesFromSnapshotTest-168877895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d65d2df5-9fd6-403a-b1e1-507b951237f1" returned: 0 in 0.762s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7e1783cc-72ab-4084-a300-08a207912d3a tempest-CreateVolumesFromSnapshotTest-168877895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d65d2df5-9fd6-403a-b1e1-507b951237f1 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:12 devstack sudo[92928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d65d2df5-9fd6-403a-b1e1-507b951237f1 Apr 28 19:25:12 devstack sudo[92928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:13 devstack sudo[92928]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7e1783cc-72ab-4084-a300-08a207912d3a tempest-CreateVolumesFromSnapshotTest-168877895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d65d2df5-9fd6-403a-b1e1-507b951237f1" returned: 0 in 0.682s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:13 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7e1783cc-72ab-4084-a300-08a207912d3a tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "cinder-quobyte-d65d2df5-9fd6-403a-b1e1-507b951237f1" released by "delete_volume" :: held 1.491s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:25:13 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-7e1783cc-72ab-4084-a300-08a207912d3a tempest-CreateVolumesFromSnapshotTest-168877895 None] Created reservations ['741e91c0-5597-4143-bc6f-ac6d99113278', '14262c42-8952-4cdb-b2fd-e6b606e15656', '3be0c74c-f122-4606-bb87-b92f1aedb312', 'b3bd4652-6287-4f7b-8fa8-cebed92d1419'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:25:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7e1783cc-72ab-4084-a300-08a207912d3a tempest-CreateVolumesFromSnapshotTest-168877895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:25:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7e1783cc-72ab-4084-a300-08a207912d3a tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:25:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7e1783cc-72ab-4084-a300-08a207912d3a tempest-CreateVolumesFromSnapshotTest-168877895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:25:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7e1783cc-72ab-4084-a300-08a207912d3a tempest-CreateVolumesFromSnapshotTest-168877895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:25:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7e1783cc-72ab-4084-a300-08a207912d3a tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:25:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7e1783cc-72ab-4084-a300-08a207912d3a tempest-CreateVolumesFromSnapshotTest-168877895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:13 devstack sudo[92931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:25:13 devstack sudo[92931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:13 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-13bce1f3-23a0-4292-a4b5-66509afd4ea6 tempest-CreateVolumesFromSnapshotTest-168877895 None] Acquiring lock "cinder-b6f25089-5f3b-43eb-a370-b09826e7f7f0-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:25:13 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-13bce1f3-23a0-4292-a4b5-66509afd4ea6 tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "cinder-b6f25089-5f3b-43eb-a370-b09826e7f7f0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:25:13 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-13bce1f3-23a0-4292-a4b5-66509afd4ea6 tempest-CreateVolumesFromSnapshotTest-168877895 None] Acquiring lock "cinder-quobyte-b6f25089-5f3b-43eb-a370-b09826e7f7f0" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:25:13 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-13bce1f3-23a0-4292-a4b5-66509afd4ea6 tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "cinder-quobyte-b6f25089-5f3b-43eb-a370-b09826e7f7f0" acquired by "delete_volume" :: waited 0.021s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:25:13 devstack sudo[92931]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7e1783cc-72ab-4084-a300-08a207912d3a tempest-CreateVolumesFromSnapshotTest-168877895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.694s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:13 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-7e1783cc-72ab-4084-a300-08a207912d3a tempest-CreateVolumesFromSnapshotTest-168877895 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:25:13 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-7e1783cc-72ab-4084-a300-08a207912d3a tempest-CreateVolumesFromSnapshotTest-168877895 None] Deleted volume successfully. Apr 28 19:25:13 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[14974eec-c1f7-4691-ba48-313b8ef7e83e]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:25:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-13bce1f3-23a0-4292-a4b5-66509afd4ea6 tempest-CreateVolumesFromSnapshotTest-168877895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b6f25089-5f3b-43eb-a370-b09826e7f7f0 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:14 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7e1783cc-72ab-4084-a300-08a207912d3a tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "cinder-d65d2df5-9fd6-403a-b1e1-507b951237f1-delete_volume" released by "delete_volume" :: held 2.420s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:25:14 devstack sudo[92934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b6f25089-5f3b-43eb-a370-b09826e7f7f0 Apr 28 19:25:14 devstack sudo[92934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:14 devstack sudo[92934]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-13bce1f3-23a0-4292-a4b5-66509afd4ea6 tempest-CreateVolumesFromSnapshotTest-168877895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b6f25089-5f3b-43eb-a370-b09826e7f7f0" returned: 0 in 0.817s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-13bce1f3-23a0-4292-a4b5-66509afd4ea6 tempest-CreateVolumesFromSnapshotTest-168877895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b6f25089-5f3b-43eb-a370-b09826e7f7f0 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:14 devstack sudo[92939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b6f25089-5f3b-43eb-a370-b09826e7f7f0 Apr 28 19:25:14 devstack sudo[92939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:15 devstack sudo[92939]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-13bce1f3-23a0-4292-a4b5-66509afd4ea6 tempest-CreateVolumesFromSnapshotTest-168877895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b6f25089-5f3b-43eb-a370-b09826e7f7f0" returned: 0 in 0.669s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:15 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-13bce1f3-23a0-4292-a4b5-66509afd4ea6 tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "cinder-quobyte-b6f25089-5f3b-43eb-a370-b09826e7f7f0" released by "delete_volume" :: held 1.550s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:25:15 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-13bce1f3-23a0-4292-a4b5-66509afd4ea6 tempest-CreateVolumesFromSnapshotTest-168877895 None] Created reservations ['e2c4e981-f768-4608-b35d-a52230562b85', '05c2a151-f8c1-49e0-b67c-15723db623d3', '00f0e5af-4c55-4d53-9b78-7b77287ed98e', 'a9fc794c-9e34-4169-b5a7-8170dc3fd098'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:25:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-13bce1f3-23a0-4292-a4b5-66509afd4ea6 tempest-CreateVolumesFromSnapshotTest-168877895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:25:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-13bce1f3-23a0-4292-a4b5-66509afd4ea6 tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:25:15 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-13bce1f3-23a0-4292-a4b5-66509afd4ea6 tempest-CreateVolumesFromSnapshotTest-168877895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:25:15 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-13bce1f3-23a0-4292-a4b5-66509afd4ea6 tempest-CreateVolumesFromSnapshotTest-168877895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:25:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-13bce1f3-23a0-4292-a4b5-66509afd4ea6 tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:25:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-13bce1f3-23a0-4292-a4b5-66509afd4ea6 tempest-CreateVolumesFromSnapshotTest-168877895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:15 devstack sudo[92943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:25:15 devstack sudo[92943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:16 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e5960f10-6ed1-425a-a99e-6f82746a41de tempest-CreateVolumesFromSnapshotTest-168877895 None] Acquiring lock "cinder-eb56e904-54fb-4bd1-acdd-b43d352deafc-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:25:16 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e5960f10-6ed1-425a-a99e-6f82746a41de tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "cinder-eb56e904-54fb-4bd1-acdd-b43d352deafc-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:25:16 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e5960f10-6ed1-425a-a99e-6f82746a41de tempest-CreateVolumesFromSnapshotTest-168877895 None] Acquiring lock "cinder-quobyte-eb56e904-54fb-4bd1-acdd-b43d352deafc" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:25:16 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e5960f10-6ed1-425a-a99e-6f82746a41de tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "cinder-quobyte-eb56e904-54fb-4bd1-acdd-b43d352deafc" acquired by "delete_volume" :: waited 0.017s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:25:16 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce440da-ea42-49be-999a-9a59b3458f66]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:25:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e5960f10-6ed1-425a-a99e-6f82746a41de tempest-CreateVolumesFromSnapshotTest-168877895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-eb56e904-54fb-4bd1-acdd-b43d352deafc {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:16 devstack sudo[92945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-eb56e904-54fb-4bd1-acdd-b43d352deafc Apr 28 19:25:16 devstack sudo[92945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:16 devstack sudo[92943]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-13bce1f3-23a0-4292-a4b5-66509afd4ea6 tempest-CreateVolumesFromSnapshotTest-168877895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.749s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:16 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-13bce1f3-23a0-4292-a4b5-66509afd4ea6 tempest-CreateVolumesFromSnapshotTest-168877895 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:25:16 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-13bce1f3-23a0-4292-a4b5-66509afd4ea6 tempest-CreateVolumesFromSnapshotTest-168877895 None] Deleted volume successfully. Apr 28 19:25:16 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-13bce1f3-23a0-4292-a4b5-66509afd4ea6 tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "cinder-b6f25089-5f3b-43eb-a370-b09826e7f7f0-delete_volume" released by "delete_volume" :: held 2.532s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:25:16 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-fad9ee30-bde0-44ce-9cf3-77e2a18eed5f tempest-SnapshotDependencyTests-1474552981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:25:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fad9ee30-bde0-44ce-9cf3-77e2a18eed5f tempest-SnapshotDependencyTests-1474552981 None] Flow 'volume_create_manager' (6cc40dc2-e0a5-4e25-bc97-be0f3b461421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:25:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fad9ee30-bde0-44ce-9cf3-77e2a18eed5f tempest-SnapshotDependencyTests-1474552981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be82ace7-cdaf-4a1f-82d6-e99d5b4db5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:25:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fad9ee30-bde0-44ce-9cf3-77e2a18eed5f tempest-SnapshotDependencyTests-1474552981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be82ace7-cdaf-4a1f-82d6-e99d5b4db5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-367888304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=759ad36b-ec1e-47fc-8680-62f8c60776f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa0d3527b4864091972cf216f75c3fc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:25:17Z,use_quota=True,user_id='5f735d94d882441780a655d3e9db30a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:25:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fad9ee30-bde0-44ce-9cf3-77e2a18eed5f tempest-SnapshotDependencyTests-1474552981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (378181c0-702e-4247-9b63-856a72bc7279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:25:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fad9ee30-bde0-44ce-9cf3-77e2a18eed5f tempest-SnapshotDependencyTests-1474552981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (378181c0-702e-4247-9b63-856a72bc7279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:25:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fad9ee30-bde0-44ce-9cf3-77e2a18eed5f tempest-SnapshotDependencyTests-1474552981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2184b4bd-740b-4227-8e55-b23d67b52191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:25:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fad9ee30-bde0-44ce-9cf3-77e2a18eed5f tempest-SnapshotDependencyTests-1474552981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2184b4bd-740b-4227-8e55-b23d67b52191) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '759ad36b-ec1e-47fc-8680-62f8c60776f4', 'volume_name': 'volume-759ad36b-ec1e-47fc-8680-62f8c60776f4', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:25:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fad9ee30-bde0-44ce-9cf3-77e2a18eed5f tempest-SnapshotDependencyTests-1474552981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfcd1d3a-0f52-4edc-80a2-4849798e7cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:25:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fad9ee30-bde0-44ce-9cf3-77e2a18eed5f tempest-SnapshotDependencyTests-1474552981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfcd1d3a-0f52-4edc-80a2-4849798e7cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:25:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fad9ee30-bde0-44ce-9cf3-77e2a18eed5f tempest-SnapshotDependencyTests-1474552981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a29dbde-0737-4182-878b-62d9803c6764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:25:16 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-fad9ee30-bde0-44ce-9cf3-77e2a18eed5f tempest-SnapshotDependencyTests-1474552981 None] Volume 759ad36b-ec1e-47fc-8680-62f8c60776f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-759ad36b-ec1e-47fc-8680-62f8c60776f4', 'volume_size': 1} Apr 28 19:25:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fad9ee30-bde0-44ce-9cf3-77e2a18eed5f tempest-SnapshotDependencyTests-1474552981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:25:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fad9ee30-bde0-44ce-9cf3-77e2a18eed5f tempest-SnapshotDependencyTests-1474552981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:25:16 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-fad9ee30-bde0-44ce-9cf3-77e2a18eed5f tempest-SnapshotDependencyTests-1474552981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-367888304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=759ad36b-ec1e-47fc-8680-62f8c60776f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa0d3527b4864091972cf216f75c3fc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:25:17Z,use_quota=True,user_id='5f735d94d882441780a655d3e9db30a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:25:16 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-fad9ee30-bde0-44ce-9cf3-77e2a18eed5f tempest-SnapshotDependencyTests-1474552981 None] Creating volume 759ad36b-ec1e-47fc-8680-62f8c60776f4 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:25:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fad9ee30-bde0-44ce-9cf3-77e2a18eed5f tempest-SnapshotDependencyTests-1474552981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:25:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fad9ee30-bde0-44ce-9cf3-77e2a18eed5f tempest-SnapshotDependencyTests-1474552981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:25:16 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-fad9ee30-bde0-44ce-9cf3-77e2a18eed5f tempest-SnapshotDependencyTests-1474552981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:25:16 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-fad9ee30-bde0-44ce-9cf3-77e2a18eed5f tempest-SnapshotDependencyTests-1474552981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:25:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fad9ee30-bde0-44ce-9cf3-77e2a18eed5f tempest-SnapshotDependencyTests-1474552981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:25:16 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-fad9ee30-bde0-44ce-9cf3-77e2a18eed5f tempest-SnapshotDependencyTests-1474552981 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:25:16 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-fad9ee30-bde0-44ce-9cf3-77e2a18eed5f tempest-SnapshotDependencyTests-1474552981 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:25:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fad9ee30-bde0-44ce-9cf3-77e2a18eed5f tempest-SnapshotDependencyTests-1474552981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:16 devstack sudo[92948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4 1073741824 Apr 28 19:25:16 devstack sudo[92948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:16 devstack sudo[92945]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e5960f10-6ed1-425a-a99e-6f82746a41de tempest-CreateVolumesFromSnapshotTest-168877895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-eb56e904-54fb-4bd1-acdd-b43d352deafc" returned: 0 in 0.742s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e5960f10-6ed1-425a-a99e-6f82746a41de tempest-CreateVolumesFromSnapshotTest-168877895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-eb56e904-54fb-4bd1-acdd-b43d352deafc {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:16 devstack sudo[92953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-eb56e904-54fb-4bd1-acdd-b43d352deafc Apr 28 19:25:16 devstack sudo[92953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:17 devstack sudo[92948]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fad9ee30-bde0-44ce-9cf3-77e2a18eed5f tempest-SnapshotDependencyTests-1474552981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4 1073741824" returned: 0 in 0.791s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:17 devstack sudo[92953]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e5960f10-6ed1-425a-a99e-6f82746a41de tempest-CreateVolumesFromSnapshotTest-168877895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-eb56e904-54fb-4bd1-acdd-b43d352deafc" returned: 0 in 0.659s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fad9ee30-bde0-44ce-9cf3-77e2a18eed5f tempest-SnapshotDependencyTests-1474552981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:17 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e5960f10-6ed1-425a-a99e-6f82746a41de tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "cinder-quobyte-eb56e904-54fb-4bd1-acdd-b43d352deafc" released by "delete_volume" :: held 1.458s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:25:17 devstack sudo[92959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4 Apr 28 19:25:17 devstack sudo[92959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:17 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-e5960f10-6ed1-425a-a99e-6f82746a41de tempest-CreateVolumesFromSnapshotTest-168877895 None] Created reservations ['8086d302-9b42-49ce-901e-aa1521d86df7', '1688c14f-48c0-4274-9013-67ffd47e5c6f', 'a2cc05e7-3252-47af-af4a-fca5e4cc0f1a', '1a4305de-8091-4bb8-85c4-5f615045f107'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:25:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e5960f10-6ed1-425a-a99e-6f82746a41de tempest-CreateVolumesFromSnapshotTest-168877895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:25:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e5960f10-6ed1-425a-a99e-6f82746a41de tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:25:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-e5960f10-6ed1-425a-a99e-6f82746a41de tempest-CreateVolumesFromSnapshotTest-168877895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:25:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-e5960f10-6ed1-425a-a99e-6f82746a41de tempest-CreateVolumesFromSnapshotTest-168877895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:25:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e5960f10-6ed1-425a-a99e-6f82746a41de tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:25:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e5960f10-6ed1-425a-a99e-6f82746a41de tempest-CreateVolumesFromSnapshotTest-168877895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:17 devstack sudo[93022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:25:17 devstack sudo[93022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:18 devstack sudo[92959]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fad9ee30-bde0-44ce-9cf3-77e2a18eed5f tempest-SnapshotDependencyTests-1474552981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4" returned: 0 in 0.690s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:18 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-41b7db82-5aa8-4ef7-aac9-0ea553b3d85c tempest-CreateVolumesFromSnapshotTest-168877895 None] Acquiring lock "cinder-72fb769d-0f47-4932-a8da-b66749024b3e-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:25:18 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-fad9ee30-bde0-44ce-9cf3-77e2a18eed5f tempest-SnapshotDependencyTests-1474552981 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:25:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fad9ee30-bde0-44ce-9cf3-77e2a18eed5f tempest-SnapshotDependencyTests-1474552981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:25:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fad9ee30-bde0-44ce-9cf3-77e2a18eed5f tempest-SnapshotDependencyTests-1474552981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a29dbde-0737-4182-878b-62d9803c6764) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-759ad36b-ec1e-47fc-8680-62f8c60776f4', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:25:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fad9ee30-bde0-44ce-9cf3-77e2a18eed5f tempest-SnapshotDependencyTests-1474552981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3c98b7e-79d3-4640-a86a-81bb773c454b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:25:18 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-41b7db82-5aa8-4ef7-aac9-0ea553b3d85c tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "cinder-72fb769d-0f47-4932-a8da-b66749024b3e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:25:18 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-41b7db82-5aa8-4ef7-aac9-0ea553b3d85c tempest-CreateVolumesFromSnapshotTest-168877895 None] Acquiring lock "cinder-quobyte-65c727c7-8689-44b6-b721-bdd8582e0c00" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:25:18 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-fad9ee30-bde0-44ce-9cf3-77e2a18eed5f tempest-SnapshotDependencyTests-1474552981 None] Volume volume-759ad36b-ec1e-47fc-8680-62f8c60776f4 (759ad36b-ec1e-47fc-8680-62f8c60776f4): created successfully Apr 28 19:25:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fad9ee30-bde0-44ce-9cf3-77e2a18eed5f tempest-SnapshotDependencyTests-1474552981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3c98b7e-79d3-4640-a86a-81bb773c454b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:25:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fad9ee30-bde0-44ce-9cf3-77e2a18eed5f tempest-SnapshotDependencyTests-1474552981 None] Flow 'volume_create_manager' (6cc40dc2-e0a5-4e25-bc97-be0f3b461421) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:25:18 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-41b7db82-5aa8-4ef7-aac9-0ea553b3d85c tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "cinder-quobyte-65c727c7-8689-44b6-b721-bdd8582e0c00" acquired by "delete_snapshot" :: waited 0.032s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:25:18 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-41b7db82-5aa8-4ef7-aac9-0ea553b3d85c tempest-CreateVolumesFromSnapshotTest-168877895 None] Acquiring lock "cinder-quobyte-72fb769d-0f47-4932-a8da-b66749024b3e" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:25:18 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-fad9ee30-bde0-44ce-9cf3-77e2a18eed5f tempest-SnapshotDependencyTests-1474552981 None] Created volume successfully. Apr 28 19:25:18 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-41b7db82-5aa8-4ef7-aac9-0ea553b3d85c tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "cinder-quobyte-72fb769d-0f47-4932-a8da-b66749024b3e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:25:18 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-41b7db82-5aa8-4ef7-aac9-0ea553b3d85c tempest-CreateVolumesFromSnapshotTest-168877895 None] Deleting offline snapshot 72fb769d-0f47-4932-a8da-b66749024b3e of volume 65c727c7-8689-44b6-b721-bdd8582e0c00 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 19:25:18 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-41b7db82-5aa8-4ef7-aac9-0ea553b3d85c tempest-CreateVolumesFromSnapshotTest-168877895 None] snapshot_file for this snap is: volume-65c727c7-8689-44b6-b721-bdd8582e0c00.72fb769d-0f47-4932-a8da-b66749024b3e {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 19:25:18 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c3161c-d72d-4b43-a7f3-4346b7923449]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:25:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-41b7db82-5aa8-4ef7-aac9-0ea553b3d85c tempest-CreateVolumesFromSnapshotTest-168877895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-65c727c7-8689-44b6-b721-bdd8582e0c00.72fb769d-0f47-4932-a8da-b66749024b3e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:18 devstack sudo[93022]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e5960f10-6ed1-425a-a99e-6f82746a41de tempest-CreateVolumesFromSnapshotTest-168877895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.674s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:18 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-e5960f10-6ed1-425a-a99e-6f82746a41de tempest-CreateVolumesFromSnapshotTest-168877895 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:25:18 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-e5960f10-6ed1-425a-a99e-6f82746a41de tempest-CreateVolumesFromSnapshotTest-168877895 None] Deleted volume successfully. Apr 28 19:25:18 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e5960f10-6ed1-425a-a99e-6f82746a41de tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "cinder-eb56e904-54fb-4bd1-acdd-b43d352deafc-delete_volume" released by "delete_volume" :: held 2.393s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:25:18 devstack sudo[93052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-65c727c7-8689-44b6-b721-bdd8582e0c00.72fb769d-0f47-4932-a8da-b66749024b3e Apr 28 19:25:18 devstack sudo[93052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-343eaa55-d1e6-422c-9973-e430436120f1 tempest-SnapshotDependencyTests-1474552981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:25:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-343eaa55-d1e6-422c-9973-e430436120f1 tempest-SnapshotDependencyTests-1474552981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:25:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-343eaa55-d1e6-422c-9973-e430436120f1 tempest-SnapshotDependencyTests-1474552981 None] Creating offline snapshot 801317ab-1798-4089-a12d-9e4fad07eb12 of volume 759ad36b-ec1e-47fc-8680-62f8c60776f4 {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 19:25:19 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f5297a-5b5c-4dfc-9830-a5cfa21547ba]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:25:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-343eaa55-d1e6-422c-9973-e430436120f1 tempest-SnapshotDependencyTests-1474552981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:19 devstack sudo[93052]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-41b7db82-5aa8-4ef7-aac9-0ea553b3d85c tempest-CreateVolumesFromSnapshotTest-168877895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-65c727c7-8689-44b6-b721-bdd8582e0c00.72fb769d-0f47-4932-a8da-b66749024b3e" returned: 0 in 0.774s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-41b7db82-5aa8-4ef7-aac9-0ea553b3d85c tempest-CreateVolumesFromSnapshotTest-168877895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65c727c7-8689-44b6-b721-bdd8582e0c00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:25:19 devstack sudo[93058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4 Apr 28 19:25:19 devstack sudo[93058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:19 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17c1d0c-c6a6-4a25-94b7-a7d774345818]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:25:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-41b7db82-5aa8-4ef7-aac9-0ea553b3d85c tempest-CreateVolumesFromSnapshotTest-168877895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-65c727c7-8689-44b6-b721-bdd8582e0c00 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:19 devstack sudo[93060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-65c727c7-8689-44b6-b721-bdd8582e0c00 Apr 28 19:25:19 devstack sudo[93060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:19 devstack sudo[93058]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-343eaa55-d1e6-422c-9973-e430436120f1 tempest-SnapshotDependencyTests-1474552981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4" returned: 0 in 0.802s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-343eaa55-d1e6-422c-9973-e430436120f1 tempest-SnapshotDependencyTests-1474552981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4.801317ab-1798-4089-a12d-9e4fad07eb12 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:19 devstack sudo[93068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4.801317ab-1798-4089-a12d-9e4fad07eb12 1G Apr 28 19:25:19 devstack sudo[93068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:20 devstack sudo[93060]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-41b7db82-5aa8-4ef7-aac9-0ea553b3d85c tempest-CreateVolumesFromSnapshotTest-168877895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-65c727c7-8689-44b6-b721-bdd8582e0c00" returned: 0 in 0.765s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-41b7db82-5aa8-4ef7-aac9-0ea553b3d85c tempest-CreateVolumesFromSnapshotTest-168877895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-65c727c7-8689-44b6-b721-bdd8582e0c00.72fb769d-0f47-4932-a8da-b66749024b3e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:20 devstack sudo[93070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-65c727c7-8689-44b6-b721-bdd8582e0c00.72fb769d-0f47-4932-a8da-b66749024b3e Apr 28 19:25:20 devstack sudo[93070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:20 devstack sudo[93068]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-343eaa55-d1e6-422c-9973-e430436120f1 tempest-SnapshotDependencyTests-1474552981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4.801317ab-1798-4089-a12d-9e4fad07eb12 1G" returned: 0 in 0.806s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-343eaa55-d1e6-422c-9973-e430436120f1 tempest-SnapshotDependencyTests-1474552981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-759ad36b-ec1e-47fc-8680-62f8c60776f4 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4.801317ab-1798-4089-a12d-9e4fad07eb12 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:20 devstack sudo[93079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-759ad36b-ec1e-47fc-8680-62f8c60776f4 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4.801317ab-1798-4089-a12d-9e4fad07eb12 Apr 28 19:25:20 devstack sudo[93079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:20 devstack sudo[93070]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-41b7db82-5aa8-4ef7-aac9-0ea553b3d85c tempest-CreateVolumesFromSnapshotTest-168877895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-65c727c7-8689-44b6-b721-bdd8582e0c00.72fb769d-0f47-4932-a8da-b66749024b3e" returned: 0 in 0.746s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-41b7db82-5aa8-4ef7-aac9-0ea553b3d85c tempest-CreateVolumesFromSnapshotTest-168877895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-65c727c7-8689-44b6-b721-bdd8582e0c00.72fb769d-0f47-4932-a8da-b66749024b3e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:20 devstack sudo[93081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-65c727c7-8689-44b6-b721-bdd8582e0c00.72fb769d-0f47-4932-a8da-b66749024b3e Apr 28 19:25:20 devstack sudo[93081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:21 devstack sudo[93079]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-343eaa55-d1e6-422c-9973-e430436120f1 tempest-SnapshotDependencyTests-1474552981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-759ad36b-ec1e-47fc-8680-62f8c60776f4 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4.801317ab-1798-4089-a12d-9e4fad07eb12" returned: 0 in 0.659s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:21 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-343eaa55-d1e6-422c-9973-e430436120f1 tempest-SnapshotDependencyTests-1474552981 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4.801317ab-1798-4089-a12d-9e4fad07eb12 is being set with open permissions: ugo+rw Apr 28 19:25:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-343eaa55-d1e6-422c-9973-e430436120f1 tempest-SnapshotDependencyTests-1474552981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4.801317ab-1798-4089-a12d-9e4fad07eb12 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:21 devstack sudo[93088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4.801317ab-1798-4089-a12d-9e4fad07eb12 Apr 28 19:25:21 devstack sudo[93088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:21 devstack sudo[93081]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-41b7db82-5aa8-4ef7-aac9-0ea553b3d85c tempest-CreateVolumesFromSnapshotTest-168877895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-65c727c7-8689-44b6-b721-bdd8582e0c00.72fb769d-0f47-4932-a8da-b66749024b3e" returned: 0 in 0.645s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:21 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-41b7db82-5aa8-4ef7-aac9-0ea553b3d85c tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "cinder-quobyte-72fb769d-0f47-4932-a8da-b66749024b3e" released by "_delete_snapshot" :: held 3.060s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:25:21 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-41b7db82-5aa8-4ef7-aac9-0ea553b3d85c tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "cinder-quobyte-65c727c7-8689-44b6-b721-bdd8582e0c00" released by "delete_snapshot" :: held 3.087s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:25:21 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-41b7db82-5aa8-4ef7-aac9-0ea553b3d85c tempest-CreateVolumesFromSnapshotTest-168877895 None] Created reservations ['d533709d-d08d-4b00-b180-bc42e4e15191', '84df86e0-666d-497e-a79e-73c8f3f3d130', 'bb2dd9ad-5f47-4713-b70f-45e578f36757', 'f419fc93-d51e-472f-aadc-a960eaf7e162'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:25:21 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-41b7db82-5aa8-4ef7-aac9-0ea553b3d85c tempest-CreateVolumesFromSnapshotTest-168877895 None] Delete snapshot completed successfully. Apr 28 19:25:21 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-41b7db82-5aa8-4ef7-aac9-0ea553b3d85c tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "cinder-72fb769d-0f47-4932-a8da-b66749024b3e-delete_snapshot" released by "delete_snapshot" :: held 3.237s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:25:22 devstack sudo[93088]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-343eaa55-d1e6-422c-9973-e430436120f1 tempest-SnapshotDependencyTests-1474552981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4.801317ab-1798-4089-a12d-9e4fad07eb12" returned: 0 in 0.610s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-343eaa55-d1e6-422c-9973-e430436120f1 tempest-SnapshotDependencyTests-1474552981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:22 devstack sudo[93091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4.info Apr 28 19:25:22 devstack sudo[93091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:22 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-b5816c09-8949-43c3-a79b-f64958005c29 tempest-CreateVolumesFromSnapshotTest-168877895 None] Acquiring lock "cinder-65c727c7-8689-44b6-b721-bdd8582e0c00-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:25:22 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-b5816c09-8949-43c3-a79b-f64958005c29 tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "cinder-65c727c7-8689-44b6-b721-bdd8582e0c00-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:25:22 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-b5816c09-8949-43c3-a79b-f64958005c29 tempest-CreateVolumesFromSnapshotTest-168877895 None] Acquiring lock "cinder-quobyte-65c727c7-8689-44b6-b721-bdd8582e0c00" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:25:22 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-b5816c09-8949-43c3-a79b-f64958005c29 tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "cinder-quobyte-65c727c7-8689-44b6-b721-bdd8582e0c00" acquired by "delete_volume" :: waited 0.015s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:25:22 devstack sudo[93091]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-343eaa55-d1e6-422c-9973-e430436120f1 tempest-SnapshotDependencyTests-1474552981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4.info" returned: 0 in 0.646s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:22 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-343eaa55-d1e6-422c-9973-e430436120f1 tempest-SnapshotDependencyTests-1474552981 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4.info is being set with open permissions: ugo+rw Apr 28 19:25:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-343eaa55-d1e6-422c-9973-e430436120f1 tempest-SnapshotDependencyTests-1474552981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:22 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5097b9a5-9647-45bb-9d0a-1807f8893592]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:25:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b5816c09-8949-43c3-a79b-f64958005c29 tempest-CreateVolumesFromSnapshotTest-168877895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-65c727c7-8689-44b6-b721-bdd8582e0c00 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:22 devstack sudo[93094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4.info Apr 28 19:25:22 devstack sudo[93094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:22 devstack sudo[93095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-65c727c7-8689-44b6-b721-bdd8582e0c00 Apr 28 19:25:22 devstack sudo[93095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:23 devstack sudo[93094]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-343eaa55-d1e6-422c-9973-e430436120f1 tempest-SnapshotDependencyTests-1474552981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4.info" returned: 0 in 0.634s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-343eaa55-d1e6-422c-9973-e430436120f1 tempest-SnapshotDependencyTests-1474552981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.242s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:25:23 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-343eaa55-d1e6-422c-9973-e430436120f1 tempest-SnapshotDependencyTests-1474552981 None] Create snapshot completed successfully Apr 28 19:25:23 devstack sudo[93095]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b5816c09-8949-43c3-a79b-f64958005c29 tempest-CreateVolumesFromSnapshotTest-168877895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-65c727c7-8689-44b6-b721-bdd8582e0c00" returned: 0 in 0.746s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b5816c09-8949-43c3-a79b-f64958005c29 tempest-CreateVolumesFromSnapshotTest-168877895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-65c727c7-8689-44b6-b721-bdd8582e0c00 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:23 devstack sudo[93102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-65c727c7-8689-44b6-b721-bdd8582e0c00 Apr 28 19:25:23 devstack sudo[93102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:24 devstack sudo[93102]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b5816c09-8949-43c3-a79b-f64958005c29 tempest-CreateVolumesFromSnapshotTest-168877895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-65c727c7-8689-44b6-b721-bdd8582e0c00" returned: 0 in 0.612s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:24 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-b5816c09-8949-43c3-a79b-f64958005c29 tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "cinder-quobyte-65c727c7-8689-44b6-b721-bdd8582e0c00" released by "delete_volume" :: held 1.436s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:25:24 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-b5816c09-8949-43c3-a79b-f64958005c29 tempest-CreateVolumesFromSnapshotTest-168877895 None] Created reservations ['55c3fb2b-53aa-4cfa-ba57-c65d0563ca40', '0246ec4a-f2e0-4ac7-8ea4-85b2469dad5a', '252e8f4f-db53-4311-9739-446d766b0723', '7b37408e-bf37-4437-9dc5-587196ce9daf'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:25:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b5816c09-8949-43c3-a79b-f64958005c29 tempest-CreateVolumesFromSnapshotTest-168877895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:25:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b5816c09-8949-43c3-a79b-f64958005c29 tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:25:24 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b5816c09-8949-43c3-a79b-f64958005c29 tempest-CreateVolumesFromSnapshotTest-168877895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:25:24 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b5816c09-8949-43c3-a79b-f64958005c29 tempest-CreateVolumesFromSnapshotTest-168877895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:25:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b5816c09-8949-43c3-a79b-f64958005c29 tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:25:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b5816c09-8949-43c3-a79b-f64958005c29 tempest-CreateVolumesFromSnapshotTest-168877895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:24 devstack sudo[93105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:25:24 devstack sudo[93105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:24 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:25:24 devstack sudo[93105]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b5816c09-8949-43c3-a79b-f64958005c29 tempest-CreateVolumesFromSnapshotTest-168877895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.681s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:24 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-b5816c09-8949-43c3-a79b-f64958005c29 tempest-CreateVolumesFromSnapshotTest-168877895 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:25:24 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-b5816c09-8949-43c3-a79b-f64958005c29 tempest-CreateVolumesFromSnapshotTest-168877895 None] Deleted volume successfully. Apr 28 19:25:24 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] Flow 'volume_create_manager' (fc1c45dc-20a6-42cd-aaea-714237edc62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:25:24 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce174ad1-a727-4f44-a4a0-460bfe6c248a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:25:24 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce174ad1-a727-4f44-a4a0-460bfe6c248a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8bfba11-0bcc-4963-b7b4-a0c9a09ff59a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa0d3527b4864091972cf216f75c3fc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=801317ab-1798-4089-a12d-9e4fad07eb12,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:25:25Z,use_quota=True,user_id='5f735d94d882441780a655d3e9db30a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:25:24 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7adc1ed3-4192-40a9-98d6-07ae2bfeb0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:25:24 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7adc1ed3-4192-40a9-98d6-07ae2bfeb0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:25:24 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4b5c798-98dc-49dd-8e1b-dfe94c802e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:25:24 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4b5c798-98dc-49dd-8e1b-dfe94c802e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b8bfba11-0bcc-4963-b7b4-a0c9a09ff59a', 'volume_name': 'volume-b8bfba11-0bcc-4963-b7b4-a0c9a09ff59a', 'volume_size': 1, 'snapshot_id': '801317ab-1798-4089-a12d-9e4fad07eb12'}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:25:24 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (311940c8-bd64-46f3-82be-a3e23aef98ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:25:24 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (311940c8-bd64-46f3-82be-a3e23aef98ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:25:24 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f07a96f-bdbf-45cf-ab5b-c6f95c149cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:25:24 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] Volume b8bfba11-0bcc-4963-b7b4-a0c9a09ff59a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b8bfba11-0bcc-4963-b7b4-a0c9a09ff59a', 'volume_size': 1, 'snapshot_id': '801317ab-1798-4089-a12d-9e4fad07eb12'} Apr 28 19:25:24 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-b5816c09-8949-43c3-a79b-f64958005c29 tempest-CreateVolumesFromSnapshotTest-168877895 None] Lock "cinder-65c727c7-8689-44b6-b721-bdd8582e0c00-delete_volume" released by "delete_volume" :: held 2.376s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:25:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:25:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:25:24 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] Acquiring lock "cinder-quobyte-801317ab-1798-4089-a12d-9e4fad07eb12-b8bfba11-0bcc-4963-b7b4-a0c9a09ff59a" by "_create_volume_from_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:25:24 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] Lock "cinder-quobyte-801317ab-1798-4089-a12d-9e4fad07eb12-b8bfba11-0bcc-4963-b7b4-a0c9a09ff59a" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:25:24 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] Creating volume b8bfba11-0bcc-4963-b7b4-a0c9a09ff59a from snapshot 801317ab-1798-4089-a12d-9e4fad07eb12 {{(pid=83863) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 28 19:25:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:25:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:25:24 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:25:24 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:25:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:25:24 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:25:24 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] Acquiring lock "cinder-quobyte-b8bfba11-0bcc-4963-b7b4-a0c9a09ff59a" by "_copy_volume_from_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:25:25 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] Lock "cinder-quobyte-b8bfba11-0bcc-4963-b7b4-a0c9a09ff59a" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:25:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] snapshot: 801317ab-1798-4089-a12d-9e4fad07eb12, volume: b8bfba11-0bcc-4963-b7b4-a0c9a09ff59a, {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 19:25:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:25:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:25:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:25:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:25:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:25:25 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8bfa41-a0ec-4b7c-a888-a2e2c025929e]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:25:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4.801317ab-1798-4089-a12d-9e4fad07eb12 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:25 devstack sudo[93108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4.801317ab-1798-4089-a12d-9e4fad07eb12 Apr 28 19:25:25 devstack sudo[93108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:25 devstack sudo[93108]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4.801317ab-1798-4089-a12d-9e4fad07eb12" returned: 0 in 0.767s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-759ad36b-ec1e-47fc-8680-62f8c60776f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:25:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4 {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 19:25:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] Creating direct copy from snapshot {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 19:25:25 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef22a48e-8e55-410d-9161-4e2cc862e1d5]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:25:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:25 devstack sudo[93114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4 Apr 28 19:25:26 devstack sudo[93114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:26 devstack sudo[93114]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4" returned: 0 in 0.780s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:26 devstack cinder-volume[83863]: DEBUG cinder.utils [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] Path /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b8bfba11-0bcc-4963-b7b4-a0c9a09ff59a not found in is_blk_device check {{(pid=83863) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 19:25:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b8bfba11-0bcc-4963-b7b4-a0c9a09ff59a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:26 devstack sudo[93119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b8bfba11-0bcc-4963-b7b4-a0c9a09ff59a Apr 28 19:25:26 devstack sudo[93119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:27 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-95fb32c9-4842-426d-8b86-146adb42ebc4 tempest-CinderUnicodeTest-364423762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:25:27 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-95fb32c9-4842-426d-8b86-146adb42ebc4 tempest-CinderUnicodeTest-364423762 None] Flow 'volume_create_manager' (fb160916-1ac5-4a61-8b3a-37b0bca42f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:25:27 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-95fb32c9-4842-426d-8b86-146adb42ebc4 tempest-CinderUnicodeTest-364423762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66dd4ed5-3e4f-43d4-bac1-432c56fe1627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:25:27 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-95fb32c9-4842-426d-8b86-146adb42ebc4 tempest-CinderUnicodeTest-364423762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66dd4ed5-3e4f-43d4-bac1-432c56fe1627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6165acb1-d4fa-40e8-9e2e-bd0709bb8705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1310ae47f3f545db82ba65fbfd598b21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:25:28Z,use_quota=True,user_id='80d9e2a5123b4617a333a18e21459ac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:25:27 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-95fb32c9-4842-426d-8b86-146adb42ebc4 tempest-CinderUnicodeTest-364423762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96add707-4bc3-477f-9ac0-83214c67bf6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:25:27 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-95fb32c9-4842-426d-8b86-146adb42ebc4 tempest-CinderUnicodeTest-364423762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96add707-4bc3-477f-9ac0-83214c67bf6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:25:27 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-95fb32c9-4842-426d-8b86-146adb42ebc4 tempest-CinderUnicodeTest-364423762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f94842af-0b68-489c-ada7-c9264ae616f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:25:27 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-95fb32c9-4842-426d-8b86-146adb42ebc4 tempest-CinderUnicodeTest-364423762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f94842af-0b68-489c-ada7-c9264ae616f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6165acb1-d4fa-40e8-9e2e-bd0709bb8705', 'volume_name': 'volume-6165acb1-d4fa-40e8-9e2e-bd0709bb8705', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:25:27 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-95fb32c9-4842-426d-8b86-146adb42ebc4 tempest-CinderUnicodeTest-364423762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dc5411c-7c7e-4727-ae72-8760a911f8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:25:27 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-95fb32c9-4842-426d-8b86-146adb42ebc4 tempest-CinderUnicodeTest-364423762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dc5411c-7c7e-4727-ae72-8760a911f8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:25:27 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-95fb32c9-4842-426d-8b86-146adb42ebc4 tempest-CinderUnicodeTest-364423762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8f5c928-f430-4a56-8dc0-293db773601c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:25:27 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-95fb32c9-4842-426d-8b86-146adb42ebc4 tempest-CinderUnicodeTest-364423762 None] Volume 6165acb1-d4fa-40e8-9e2e-bd0709bb8705: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6165acb1-d4fa-40e8-9e2e-bd0709bb8705', 'volume_size': 1} Apr 28 19:25:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-95fb32c9-4842-426d-8b86-146adb42ebc4 tempest-CinderUnicodeTest-364423762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:25:31 devstack sudo[93119]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b8bfba11-0bcc-4963-b7b4-a0c9a09ff59a" returned: 0 in 4.568s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:31 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[145c4664-ee77-4777-8ef0-f1ce4b5bebd9]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:25:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:31 devstack sudo[93133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4 Apr 28 19:25:31 devstack sudo[93133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:32 devstack sudo[93133]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4" returned: 0 in 0.893s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:32 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] Image conversion details: src /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4, size 1024.00 MB, duration 4.57 sec, destination /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b8bfba11-0bcc-4963-b7b4-a0c9a09ff59a {{(pid=83863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 19:25:32 devstack cinder-volume[83863]: INFO cinder.image.image_utils [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] Converted 1024.00 MB image at 224.12 MB/s Apr 28 19:25:32 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b8bfba11-0bcc-4963-b7b4-a0c9a09ff59a is being set with open permissions: ugo+rw Apr 28 19:25:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b8bfba11-0bcc-4963-b7b4-a0c9a09ff59a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:32 devstack sudo[93138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b8bfba11-0bcc-4963-b7b4-a0c9a09ff59a Apr 28 19:25:32 devstack sudo[93138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:32 devstack sudo[93138]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b8bfba11-0bcc-4963-b7b4-a0c9a09ff59a" returned: 0 in 0.610s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:32 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] Lock "cinder-quobyte-b8bfba11-0bcc-4963-b7b4-a0c9a09ff59a" released by "_copy_volume_from_snapshot" :: held 7.719s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:25:32 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] Lock "cinder-quobyte-801317ab-1798-4089-a12d-9e4fad07eb12-b8bfba11-0bcc-4963-b7b4-a0c9a09ff59a" released by "_create_volume_from_snapshot" :: held 7.760s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:25:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.778s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:25:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-95fb32c9-4842-426d-8b86-146adb42ebc4 tempest-CinderUnicodeTest-364423762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.882s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:25:32 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-95fb32c9-4842-426d-8b86-146adb42ebc4 tempest-CinderUnicodeTest-364423762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6165acb1-d4fa-40e8-9e2e-bd0709bb8705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1310ae47f3f545db82ba65fbfd598b21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:25:28Z,use_quota=True,user_id='80d9e2a5123b4617a333a18e21459ac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:25:32 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-95fb32c9-4842-426d-8b86-146adb42ebc4 tempest-CinderUnicodeTest-364423762 None] Creating volume 6165acb1-d4fa-40e8-9e2e-bd0709bb8705 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:25:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-95fb32c9-4842-426d-8b86-146adb42ebc4 tempest-CinderUnicodeTest-364423762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:25:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-95fb32c9-4842-426d-8b86-146adb42ebc4 tempest-CinderUnicodeTest-364423762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:25:32 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-95fb32c9-4842-426d-8b86-146adb42ebc4 tempest-CinderUnicodeTest-364423762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:25:32 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-95fb32c9-4842-426d-8b86-146adb42ebc4 tempest-CinderUnicodeTest-364423762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:25:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-95fb32c9-4842-426d-8b86-146adb42ebc4 tempest-CinderUnicodeTest-364423762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:25:32 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-95fb32c9-4842-426d-8b86-146adb42ebc4 tempest-CinderUnicodeTest-364423762 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:25:32 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-95fb32c9-4842-426d-8b86-146adb42ebc4 tempest-CinderUnicodeTest-364423762 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:25:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-95fb32c9-4842-426d-8b86-146adb42ebc4 tempest-CinderUnicodeTest-364423762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6165acb1-d4fa-40e8-9e2e-bd0709bb8705 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:32 devstack sudo[93141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6165acb1-d4fa-40e8-9e2e-bd0709bb8705 1073741824 Apr 28 19:25:32 devstack sudo[93141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:32 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f07a96f-bdbf-45cf-ab5b-c6f95c149cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8bfba11-0bcc-4963-b7b4-a0c9a09ff59a', 'volume_size': 1, 'snapshot_id': '801317ab-1798-4089-a12d-9e4fad07eb12'}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:25:32 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (975a260c-82b2-47eb-afed-2f9f378ad9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:25:32 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] Volume volume-b8bfba11-0bcc-4963-b7b4-a0c9a09ff59a (b8bfba11-0bcc-4963-b7b4-a0c9a09ff59a): created successfully Apr 28 19:25:32 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (975a260c-82b2-47eb-afed-2f9f378ad9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:25:32 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] Flow 'volume_create_manager' (fc1c45dc-20a6-42cd-aaea-714237edc62c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:25:32 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-5a7a1133-12d5-4909-b7b3-afcf32f5180e tempest-SnapshotDependencyTests-1474552981 None] Created volume successfully. Apr 28 19:25:33 devstack sudo[93141]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-95fb32c9-4842-426d-8b86-146adb42ebc4 tempest-CinderUnicodeTest-364423762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6165acb1-d4fa-40e8-9e2e-bd0709bb8705 1073741824" returned: 0 in 0.754s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-95fb32c9-4842-426d-8b86-146adb42ebc4 tempest-CinderUnicodeTest-364423762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6165acb1-d4fa-40e8-9e2e-bd0709bb8705 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:33 devstack sudo[93146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6165acb1-d4fa-40e8-9e2e-bd0709bb8705 Apr 28 19:25:33 devstack sudo[93146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:33 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7bd17987-3a28-499b-be48-b0f509d8873f tempest-SnapshotDependencyTests-1474552981 None] Acquiring lock "cinder-801317ab-1798-4089-a12d-9e4fad07eb12-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:25:33 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7bd17987-3a28-499b-be48-b0f509d8873f tempest-SnapshotDependencyTests-1474552981 None] Lock "cinder-801317ab-1798-4089-a12d-9e4fad07eb12-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:25:33 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7bd17987-3a28-499b-be48-b0f509d8873f tempest-SnapshotDependencyTests-1474552981 None] Acquiring lock "cinder-quobyte-759ad36b-ec1e-47fc-8680-62f8c60776f4" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:25:33 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7bd17987-3a28-499b-be48-b0f509d8873f tempest-SnapshotDependencyTests-1474552981 None] Lock "cinder-quobyte-759ad36b-ec1e-47fc-8680-62f8c60776f4" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:25:33 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7bd17987-3a28-499b-be48-b0f509d8873f tempest-SnapshotDependencyTests-1474552981 None] Acquiring lock "cinder-quobyte-801317ab-1798-4089-a12d-9e4fad07eb12" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:25:33 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7bd17987-3a28-499b-be48-b0f509d8873f tempest-SnapshotDependencyTests-1474552981 None] Lock "cinder-quobyte-801317ab-1798-4089-a12d-9e4fad07eb12" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:25:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-7bd17987-3a28-499b-be48-b0f509d8873f tempest-SnapshotDependencyTests-1474552981 None] Deleting offline snapshot 801317ab-1798-4089-a12d-9e4fad07eb12 of volume 759ad36b-ec1e-47fc-8680-62f8c60776f4 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 19:25:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-7bd17987-3a28-499b-be48-b0f509d8873f tempest-SnapshotDependencyTests-1474552981 None] snapshot_file for this snap is: volume-759ad36b-ec1e-47fc-8680-62f8c60776f4.801317ab-1798-4089-a12d-9e4fad07eb12 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 19:25:33 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf4aebd-abe6-4692-a828-b33fe91bb142]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:25:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7bd17987-3a28-499b-be48-b0f509d8873f tempest-SnapshotDependencyTests-1474552981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4.801317ab-1798-4089-a12d-9e4fad07eb12 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:33 devstack sudo[93148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4.801317ab-1798-4089-a12d-9e4fad07eb12 Apr 28 19:25:33 devstack sudo[93148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:34 devstack sudo[93146]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-95fb32c9-4842-426d-8b86-146adb42ebc4 tempest-CinderUnicodeTest-364423762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6165acb1-d4fa-40e8-9e2e-bd0709bb8705" returned: 0 in 0.629s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:34 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-95fb32c9-4842-426d-8b86-146adb42ebc4 tempest-CinderUnicodeTest-364423762 None] <== create_volume: return (1422ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:25:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-95fb32c9-4842-426d-8b86-146adb42ebc4 tempest-CinderUnicodeTest-364423762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.425s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:25:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-95fb32c9-4842-426d-8b86-146adb42ebc4 tempest-CinderUnicodeTest-364423762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8f5c928-f430-4a56-8dc0-293db773601c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6165acb1-d4fa-40e8-9e2e-bd0709bb8705', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:25:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-95fb32c9-4842-426d-8b86-146adb42ebc4 tempest-CinderUnicodeTest-364423762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f93fecf-d539-4230-ad94-bf9630dca22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:25:34 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-95fb32c9-4842-426d-8b86-146adb42ebc4 tempest-CinderUnicodeTest-364423762 None] Volume volume-6165acb1-d4fa-40e8-9e2e-bd0709bb8705 (6165acb1-d4fa-40e8-9e2e-bd0709bb8705): created successfully Apr 28 19:25:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-95fb32c9-4842-426d-8b86-146adb42ebc4 tempest-CinderUnicodeTest-364423762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f93fecf-d539-4230-ad94-bf9630dca22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:25:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-95fb32c9-4842-426d-8b86-146adb42ebc4 tempest-CinderUnicodeTest-364423762 None] Flow 'volume_create_manager' (fb160916-1ac5-4a61-8b3a-37b0bca42f86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:25:34 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-95fb32c9-4842-426d-8b86-146adb42ebc4 tempest-CinderUnicodeTest-364423762 None] Created volume successfully. Apr 28 19:25:34 devstack sudo[93148]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7bd17987-3a28-499b-be48-b0f509d8873f tempest-SnapshotDependencyTests-1474552981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4.801317ab-1798-4089-a12d-9e4fad07eb12" returned: 0 in 0.713s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:34 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-7bd17987-3a28-499b-be48-b0f509d8873f tempest-SnapshotDependencyTests-1474552981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-759ad36b-ec1e-47fc-8680-62f8c60776f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:25:34 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1131d74-2342-41e9-9108-230f5d9b0d9d]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:25:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7bd17987-3a28-499b-be48-b0f509d8873f tempest-SnapshotDependencyTests-1474552981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:34 devstack sudo[93155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4 Apr 28 19:25:34 devstack sudo[93155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:35 devstack sudo[93155]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7bd17987-3a28-499b-be48-b0f509d8873f tempest-SnapshotDependencyTests-1474552981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4" returned: 0 in 0.711s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7bd17987-3a28-499b-be48-b0f509d8873f tempest-SnapshotDependencyTests-1474552981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4.801317ab-1798-4089-a12d-9e4fad07eb12 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:35 devstack sudo[93160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4.801317ab-1798-4089-a12d-9e4fad07eb12 Apr 28 19:25:35 devstack sudo[93160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:35 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-e44a554e-5e2a-4a1e-bbe8-6f55eda64fd1 tempest-CinderUnicodeTest-364423762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:25:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e44a554e-5e2a-4a1e-bbe8-6f55eda64fd1 tempest-CinderUnicodeTest-364423762 None] Flow 'volume_create_manager' (0e5b0c34-4d9f-4404-9dad-d067140a4c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:25:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e44a554e-5e2a-4a1e-bbe8-6f55eda64fd1 tempest-CinderUnicodeTest-364423762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a07c7d5c-bd93-4ff7-9cd9-050b3ed3b04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:25:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e44a554e-5e2a-4a1e-bbe8-6f55eda64fd1 tempest-CinderUnicodeTest-364423762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a07c7d5c-bd93-4ff7-9cd9-050b3ed3b04d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:25:35Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2085219847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3466eff-6623-4475-b247-e1e51242a825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1310ae47f3f545db82ba65fbfd598b21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:25:36Z,use_quota=True,user_id='80d9e2a5123b4617a333a18e21459ac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:25:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e44a554e-5e2a-4a1e-bbe8-6f55eda64fd1 tempest-CinderUnicodeTest-364423762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7b9e806-afed-4183-942c-8b3888c1fac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:25:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e44a554e-5e2a-4a1e-bbe8-6f55eda64fd1 tempest-CinderUnicodeTest-364423762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7b9e806-afed-4183-942c-8b3888c1fac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:25:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e44a554e-5e2a-4a1e-bbe8-6f55eda64fd1 tempest-CinderUnicodeTest-364423762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f7d87f6-b85b-480a-b6cb-4db623344161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:25:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e44a554e-5e2a-4a1e-bbe8-6f55eda64fd1 tempest-CinderUnicodeTest-364423762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f7d87f6-b85b-480a-b6cb-4db623344161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3466eff-6623-4475-b247-e1e51242a825', 'volume_name': 'volume-a3466eff-6623-4475-b247-e1e51242a825', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:25:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e44a554e-5e2a-4a1e-bbe8-6f55eda64fd1 tempest-CinderUnicodeTest-364423762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6262e4cc-e16a-4af3-b881-16a290cbcac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:25:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e44a554e-5e2a-4a1e-bbe8-6f55eda64fd1 tempest-CinderUnicodeTest-364423762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6262e4cc-e16a-4af3-b881-16a290cbcac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:25:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e44a554e-5e2a-4a1e-bbe8-6f55eda64fd1 tempest-CinderUnicodeTest-364423762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe56bdb0-ac2c-41c5-b526-d9b333fdda08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:25:35 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-e44a554e-5e2a-4a1e-bbe8-6f55eda64fd1 tempest-CinderUnicodeTest-364423762 None] Volume a3466eff-6623-4475-b247-e1e51242a825: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3466eff-6623-4475-b247-e1e51242a825', 'volume_size': 1} Apr 28 19:25:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e44a554e-5e2a-4a1e-bbe8-6f55eda64fd1 tempest-CinderUnicodeTest-364423762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:25:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e44a554e-5e2a-4a1e-bbe8-6f55eda64fd1 tempest-CinderUnicodeTest-364423762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:25:35 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-e44a554e-5e2a-4a1e-bbe8-6f55eda64fd1 tempest-CinderUnicodeTest-364423762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:25:35Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2085219847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3466eff-6623-4475-b247-e1e51242a825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1310ae47f3f545db82ba65fbfd598b21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:25:36Z,use_quota=True,user_id='80d9e2a5123b4617a333a18e21459ac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:25:35 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-e44a554e-5e2a-4a1e-bbe8-6f55eda64fd1 tempest-CinderUnicodeTest-364423762 None] Creating volume a3466eff-6623-4475-b247-e1e51242a825 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:25:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e44a554e-5e2a-4a1e-bbe8-6f55eda64fd1 tempest-CinderUnicodeTest-364423762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:25:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e44a554e-5e2a-4a1e-bbe8-6f55eda64fd1 tempest-CinderUnicodeTest-364423762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:25:35 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-e44a554e-5e2a-4a1e-bbe8-6f55eda64fd1 tempest-CinderUnicodeTest-364423762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:25:35 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-e44a554e-5e2a-4a1e-bbe8-6f55eda64fd1 tempest-CinderUnicodeTest-364423762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:25:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e44a554e-5e2a-4a1e-bbe8-6f55eda64fd1 tempest-CinderUnicodeTest-364423762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:25:35 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-e44a554e-5e2a-4a1e-bbe8-6f55eda64fd1 tempest-CinderUnicodeTest-364423762 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:25:35 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-e44a554e-5e2a-4a1e-bbe8-6f55eda64fd1 tempest-CinderUnicodeTest-364423762 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:25:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e44a554e-5e2a-4a1e-bbe8-6f55eda64fd1 tempest-CinderUnicodeTest-364423762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a3466eff-6623-4475-b247-e1e51242a825 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:35 devstack sudo[93165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a3466eff-6623-4475-b247-e1e51242a825 1073741824 Apr 28 19:25:35 devstack sudo[93165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:35 devstack sudo[93160]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7bd17987-3a28-499b-be48-b0f509d8873f tempest-SnapshotDependencyTests-1474552981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4.801317ab-1798-4089-a12d-9e4fad07eb12" returned: 0 in 0.740s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7bd17987-3a28-499b-be48-b0f509d8873f tempest-SnapshotDependencyTests-1474552981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4.801317ab-1798-4089-a12d-9e4fad07eb12 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:35 devstack sudo[93167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4.801317ab-1798-4089-a12d-9e4fad07eb12 Apr 28 19:25:35 devstack sudo[93167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:36 devstack sudo[93165]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e44a554e-5e2a-4a1e-bbe8-6f55eda64fd1 tempest-CinderUnicodeTest-364423762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a3466eff-6623-4475-b247-e1e51242a825 1073741824" returned: 0 in 0.787s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:36 devstack sudo[93167]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7bd17987-3a28-499b-be48-b0f509d8873f tempest-SnapshotDependencyTests-1474552981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4.801317ab-1798-4089-a12d-9e4fad07eb12" returned: 0 in 0.641s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:36 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7bd17987-3a28-499b-be48-b0f509d8873f tempest-SnapshotDependencyTests-1474552981 None] Lock "cinder-quobyte-801317ab-1798-4089-a12d-9e4fad07eb12" released by "_delete_snapshot" :: held 2.896s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:25:36 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7bd17987-3a28-499b-be48-b0f509d8873f tempest-SnapshotDependencyTests-1474552981 None] Lock "cinder-quobyte-759ad36b-ec1e-47fc-8680-62f8c60776f4" released by "delete_snapshot" :: held 2.925s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:25:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e44a554e-5e2a-4a1e-bbe8-6f55eda64fd1 tempest-CinderUnicodeTest-364423762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a3466eff-6623-4475-b247-e1e51242a825 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:36 devstack sudo[93174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a3466eff-6623-4475-b247-e1e51242a825 Apr 28 19:25:36 devstack sudo[93174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:36 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-7bd17987-3a28-499b-be48-b0f509d8873f tempest-SnapshotDependencyTests-1474552981 None] Created reservations ['f06eb7c4-82e0-4f21-9c53-b0e5a7a30eb4', '3fe930f1-cff1-4e4b-9175-be653926fdbf', 'e50b1ced-b885-4ad0-9bec-9fa4c8955bcd', '29c9810a-57d6-4a48-8278-1d155a505137'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:25:36 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-7bd17987-3a28-499b-be48-b0f509d8873f tempest-SnapshotDependencyTests-1474552981 None] Delete snapshot completed successfully. Apr 28 19:25:36 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7bd17987-3a28-499b-be48-b0f509d8873f tempest-SnapshotDependencyTests-1474552981 None] Lock "cinder-801317ab-1798-4089-a12d-9e4fad07eb12-delete_snapshot" released by "delete_snapshot" :: held 3.134s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:25:36 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6ac2bf20-acd0-4075-876f-9a3400820dd0 tempest-SnapshotDependencyTests-1474552981 None] Acquiring lock "cinder-759ad36b-ec1e-47fc-8680-62f8c60776f4-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:25:36 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6ac2bf20-acd0-4075-876f-9a3400820dd0 tempest-SnapshotDependencyTests-1474552981 None] Lock "cinder-759ad36b-ec1e-47fc-8680-62f8c60776f4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:25:36 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6ac2bf20-acd0-4075-876f-9a3400820dd0 tempest-SnapshotDependencyTests-1474552981 None] Acquiring lock "cinder-quobyte-759ad36b-ec1e-47fc-8680-62f8c60776f4" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:25:36 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6ac2bf20-acd0-4075-876f-9a3400820dd0 tempest-SnapshotDependencyTests-1474552981 None] Lock "cinder-quobyte-759ad36b-ec1e-47fc-8680-62f8c60776f4" acquired by "delete_volume" :: waited 0.017s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:25:36 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[49407301-f2af-450b-b723-5298967e1714]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:25:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6ac2bf20-acd0-4075-876f-9a3400820dd0 tempest-SnapshotDependencyTests-1474552981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:37 devstack sudo[93176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4 Apr 28 19:25:37 devstack sudo[93176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:37 devstack sudo[93174]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e44a554e-5e2a-4a1e-bbe8-6f55eda64fd1 tempest-CinderUnicodeTest-364423762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a3466eff-6623-4475-b247-e1e51242a825" returned: 0 in 0.662s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:37 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-e44a554e-5e2a-4a1e-bbe8-6f55eda64fd1 tempest-CinderUnicodeTest-364423762 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:25:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e44a554e-5e2a-4a1e-bbe8-6f55eda64fd1 tempest-CinderUnicodeTest-364423762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.529s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:25:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e44a554e-5e2a-4a1e-bbe8-6f55eda64fd1 tempest-CinderUnicodeTest-364423762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe56bdb0-ac2c-41c5-b526-d9b333fdda08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3466eff-6623-4475-b247-e1e51242a825', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:25:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e44a554e-5e2a-4a1e-bbe8-6f55eda64fd1 tempest-CinderUnicodeTest-364423762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78e1a263-7578-43a2-b19a-cebe22bc611e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:25:37 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-e44a554e-5e2a-4a1e-bbe8-6f55eda64fd1 tempest-CinderUnicodeTest-364423762 None] Volume volume-a3466eff-6623-4475-b247-e1e51242a825 (a3466eff-6623-4475-b247-e1e51242a825): created successfully Apr 28 19:25:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e44a554e-5e2a-4a1e-bbe8-6f55eda64fd1 tempest-CinderUnicodeTest-364423762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78e1a263-7578-43a2-b19a-cebe22bc611e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:25:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e44a554e-5e2a-4a1e-bbe8-6f55eda64fd1 tempest-CinderUnicodeTest-364423762 None] Flow 'volume_create_manager' (0e5b0c34-4d9f-4404-9dad-d067140a4c9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:25:37 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-e44a554e-5e2a-4a1e-bbe8-6f55eda64fd1 tempest-CinderUnicodeTest-364423762 None] Created volume successfully. Apr 28 19:25:37 devstack sudo[93176]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6ac2bf20-acd0-4075-876f-9a3400820dd0 tempest-SnapshotDependencyTests-1474552981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4" returned: 0 in 0.744s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6ac2bf20-acd0-4075-876f-9a3400820dd0 tempest-SnapshotDependencyTests-1474552981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:37 devstack sudo[93182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4 Apr 28 19:25:37 devstack sudo[93182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-21992228-83ce-4eb3-9c7b-608da8fc095b tempest-CinderUnicodeTest-364423762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:25:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-21992228-83ce-4eb3-9c7b-608da8fc095b tempest-CinderUnicodeTest-364423762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:25:38 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-21992228-83ce-4eb3-9c7b-608da8fc095b tempest-CinderUnicodeTest-364423762 None] Creating offline snapshot 5d812ec5-36be-420f-9d52-287044c4df4a of volume a3466eff-6623-4475-b247-e1e51242a825 {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 19:25:38 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8e0e02-ee7e-47b4-b879-b2b894e6b123]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:25:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-21992228-83ce-4eb3-9c7b-608da8fc095b tempest-CinderUnicodeTest-364423762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a3466eff-6623-4475-b247-e1e51242a825 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:38 devstack sudo[93184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a3466eff-6623-4475-b247-e1e51242a825 Apr 28 19:25:38 devstack sudo[93184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:38 devstack sudo[93182]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6ac2bf20-acd0-4075-876f-9a3400820dd0 tempest-SnapshotDependencyTests-1474552981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-759ad36b-ec1e-47fc-8680-62f8c60776f4" returned: 0 in 0.618s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:38 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6ac2bf20-acd0-4075-876f-9a3400820dd0 tempest-SnapshotDependencyTests-1474552981 None] Lock "cinder-quobyte-759ad36b-ec1e-47fc-8680-62f8c60776f4" released by "delete_volume" :: held 1.434s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:25:38 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-6ac2bf20-acd0-4075-876f-9a3400820dd0 tempest-SnapshotDependencyTests-1474552981 None] Created reservations ['487ce97a-319f-466a-a780-75320383c4b6', 'dee56675-fc51-4006-bfc0-d1d9d21001cc', '483903f8-b645-4c91-9b9f-7cf93a8ad03c', '36f9ae7c-257c-4f99-9c76-19b02504e186'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:25:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6ac2bf20-acd0-4075-876f-9a3400820dd0 tempest-SnapshotDependencyTests-1474552981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:25:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6ac2bf20-acd0-4075-876f-9a3400820dd0 tempest-SnapshotDependencyTests-1474552981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:25:38 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6ac2bf20-acd0-4075-876f-9a3400820dd0 tempest-SnapshotDependencyTests-1474552981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:25:38 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6ac2bf20-acd0-4075-876f-9a3400820dd0 tempest-SnapshotDependencyTests-1474552981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:25:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6ac2bf20-acd0-4075-876f-9a3400820dd0 tempest-SnapshotDependencyTests-1474552981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:25:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6ac2bf20-acd0-4075-876f-9a3400820dd0 tempest-SnapshotDependencyTests-1474552981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:38 devstack sudo[93221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:25:38 devstack sudo[93221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:38 devstack sudo[93184]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-21992228-83ce-4eb3-9c7b-608da8fc095b tempest-CinderUnicodeTest-364423762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a3466eff-6623-4475-b247-e1e51242a825" returned: 0 in 0.737s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-21992228-83ce-4eb3-9c7b-608da8fc095b tempest-CinderUnicodeTest-364423762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a3466eff-6623-4475-b247-e1e51242a825,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a3466eff-6623-4475-b247-e1e51242a825.5d812ec5-36be-420f-9d52-287044c4df4a 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:38 devstack sudo[93228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a3466eff-6623-4475-b247-e1e51242a825,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a3466eff-6623-4475-b247-e1e51242a825.5d812ec5-36be-420f-9d52-287044c4df4a 1G Apr 28 19:25:38 devstack sudo[93228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:39 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c656daf6-ee25-45ac-a041-293fc3dcaa00 tempest-SnapshotDependencyTests-1474552981 None] Acquiring lock "cinder-b8bfba11-0bcc-4963-b7b4-a0c9a09ff59a-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:25:39 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c656daf6-ee25-45ac-a041-293fc3dcaa00 tempest-SnapshotDependencyTests-1474552981 None] Lock "cinder-b8bfba11-0bcc-4963-b7b4-a0c9a09ff59a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:25:39 devstack sudo[93221]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6ac2bf20-acd0-4075-876f-9a3400820dd0 tempest-SnapshotDependencyTests-1474552981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.682s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:39 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-6ac2bf20-acd0-4075-876f-9a3400820dd0 tempest-SnapshotDependencyTests-1474552981 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:25:39 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-6ac2bf20-acd0-4075-876f-9a3400820dd0 tempest-SnapshotDependencyTests-1474552981 None] Deleted volume successfully. Apr 28 19:25:39 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c656daf6-ee25-45ac-a041-293fc3dcaa00 tempest-SnapshotDependencyTests-1474552981 None] Acquiring lock "cinder-quobyte-b8bfba11-0bcc-4963-b7b4-a0c9a09ff59a" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:25:39 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6ac2bf20-acd0-4075-876f-9a3400820dd0 tempest-SnapshotDependencyTests-1474552981 None] Lock "cinder-759ad36b-ec1e-47fc-8680-62f8c60776f4-delete_volume" released by "delete_volume" :: held 2.337s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:25:39 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c656daf6-ee25-45ac-a041-293fc3dcaa00 tempest-SnapshotDependencyTests-1474552981 None] Lock "cinder-quobyte-b8bfba11-0bcc-4963-b7b4-a0c9a09ff59a" acquired by "delete_volume" :: waited 0.018s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:25:39 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c556f0d-53c2-441e-b110-5007c02155c2]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:25:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c656daf6-ee25-45ac-a041-293fc3dcaa00 tempest-SnapshotDependencyTests-1474552981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b8bfba11-0bcc-4963-b7b4-a0c9a09ff59a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:39 devstack sudo[93231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b8bfba11-0bcc-4963-b7b4-a0c9a09ff59a Apr 28 19:25:39 devstack sudo[93231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:39 devstack sudo[93228]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-21992228-83ce-4eb3-9c7b-608da8fc095b tempest-CinderUnicodeTest-364423762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a3466eff-6623-4475-b247-e1e51242a825,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a3466eff-6623-4475-b247-e1e51242a825.5d812ec5-36be-420f-9d52-287044c4df4a 1G" returned: 0 in 0.757s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-21992228-83ce-4eb3-9c7b-608da8fc095b tempest-CinderUnicodeTest-364423762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3466eff-6623-4475-b247-e1e51242a825 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a3466eff-6623-4475-b247-e1e51242a825.5d812ec5-36be-420f-9d52-287044c4df4a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:39 devstack sudo[93236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3466eff-6623-4475-b247-e1e51242a825 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a3466eff-6623-4475-b247-e1e51242a825.5d812ec5-36be-420f-9d52-287044c4df4a Apr 28 19:25:39 devstack sudo[93236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:39 devstack sudo[93231]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c656daf6-ee25-45ac-a041-293fc3dcaa00 tempest-SnapshotDependencyTests-1474552981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b8bfba11-0bcc-4963-b7b4-a0c9a09ff59a" returned: 0 in 0.731s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c656daf6-ee25-45ac-a041-293fc3dcaa00 tempest-SnapshotDependencyTests-1474552981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b8bfba11-0bcc-4963-b7b4-a0c9a09ff59a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:40 devstack sudo[93241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b8bfba11-0bcc-4963-b7b4-a0c9a09ff59a Apr 28 19:25:40 devstack sudo[93241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:40 devstack sudo[93236]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-21992228-83ce-4eb3-9c7b-608da8fc095b tempest-CinderUnicodeTest-364423762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3466eff-6623-4475-b247-e1e51242a825 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a3466eff-6623-4475-b247-e1e51242a825.5d812ec5-36be-420f-9d52-287044c4df4a" returned: 0 in 0.639s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:40 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-21992228-83ce-4eb3-9c7b-608da8fc095b tempest-CinderUnicodeTest-364423762 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a3466eff-6623-4475-b247-e1e51242a825.5d812ec5-36be-420f-9d52-287044c4df4a is being set with open permissions: ugo+rw Apr 28 19:25:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-21992228-83ce-4eb3-9c7b-608da8fc095b tempest-CinderUnicodeTest-364423762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a3466eff-6623-4475-b247-e1e51242a825.5d812ec5-36be-420f-9d52-287044c4df4a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:40 devstack sudo[93246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a3466eff-6623-4475-b247-e1e51242a825.5d812ec5-36be-420f-9d52-287044c4df4a Apr 28 19:25:40 devstack sudo[93246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:40 devstack sudo[93241]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c656daf6-ee25-45ac-a041-293fc3dcaa00 tempest-SnapshotDependencyTests-1474552981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b8bfba11-0bcc-4963-b7b4-a0c9a09ff59a" returned: 0 in 0.620s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:40 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c656daf6-ee25-45ac-a041-293fc3dcaa00 tempest-SnapshotDependencyTests-1474552981 None] Lock "cinder-quobyte-b8bfba11-0bcc-4963-b7b4-a0c9a09ff59a" released by "delete_volume" :: held 1.394s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:25:40 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-c656daf6-ee25-45ac-a041-293fc3dcaa00 tempest-SnapshotDependencyTests-1474552981 None] Created reservations ['7bf6a4ac-01d7-4253-ac4d-2bc1a8517745', '7031bf08-4056-4801-89e4-3ab059c6fe38', '30ff185a-99b8-4a18-8243-673a63b2cfc2', '8df4a4ef-6985-4479-b701-e3b437a332f8'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:25:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c656daf6-ee25-45ac-a041-293fc3dcaa00 tempest-SnapshotDependencyTests-1474552981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:25:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c656daf6-ee25-45ac-a041-293fc3dcaa00 tempest-SnapshotDependencyTests-1474552981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:25:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c656daf6-ee25-45ac-a041-293fc3dcaa00 tempest-SnapshotDependencyTests-1474552981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:25:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c656daf6-ee25-45ac-a041-293fc3dcaa00 tempest-SnapshotDependencyTests-1474552981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:25:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c656daf6-ee25-45ac-a041-293fc3dcaa00 tempest-SnapshotDependencyTests-1474552981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:25:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c656daf6-ee25-45ac-a041-293fc3dcaa00 tempest-SnapshotDependencyTests-1474552981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:40 devstack sudo[93249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:25:40 devstack sudo[93249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:40 devstack sudo[93246]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-21992228-83ce-4eb3-9c7b-608da8fc095b tempest-CinderUnicodeTest-364423762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a3466eff-6623-4475-b247-e1e51242a825.5d812ec5-36be-420f-9d52-287044c4df4a" returned: 0 in 0.588s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-21992228-83ce-4eb3-9c7b-608da8fc095b tempest-CinderUnicodeTest-364423762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a3466eff-6623-4475-b247-e1e51242a825.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:40 devstack sudo[93253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a3466eff-6623-4475-b247-e1e51242a825.info Apr 28 19:25:40 devstack sudo[93253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:41 devstack sudo[93249]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c656daf6-ee25-45ac-a041-293fc3dcaa00 tempest-SnapshotDependencyTests-1474552981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.620s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:41 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-c656daf6-ee25-45ac-a041-293fc3dcaa00 tempest-SnapshotDependencyTests-1474552981 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:25:41 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-c656daf6-ee25-45ac-a041-293fc3dcaa00 tempest-SnapshotDependencyTests-1474552981 None] Deleted volume successfully. Apr 28 19:25:41 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c656daf6-ee25-45ac-a041-293fc3dcaa00 tempest-SnapshotDependencyTests-1474552981 None] Lock "cinder-b8bfba11-0bcc-4963-b7b4-a0c9a09ff59a-delete_volume" released by "delete_volume" :: held 2.250s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:25:41 devstack sudo[93253]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-21992228-83ce-4eb3-9c7b-608da8fc095b tempest-CinderUnicodeTest-364423762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a3466eff-6623-4475-b247-e1e51242a825.info" returned: 0 in 0.601s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:41 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-21992228-83ce-4eb3-9c7b-608da8fc095b tempest-CinderUnicodeTest-364423762 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a3466eff-6623-4475-b247-e1e51242a825.info is being set with open permissions: ugo+rw Apr 28 19:25:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-21992228-83ce-4eb3-9c7b-608da8fc095b tempest-CinderUnicodeTest-364423762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a3466eff-6623-4475-b247-e1e51242a825.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:41 devstack sudo[93257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a3466eff-6623-4475-b247-e1e51242a825.info Apr 28 19:25:41 devstack sudo[93257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:42 devstack sudo[93257]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-21992228-83ce-4eb3-9c7b-608da8fc095b tempest-CinderUnicodeTest-364423762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a3466eff-6623-4475-b247-e1e51242a825.info" returned: 0 in 0.621s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-21992228-83ce-4eb3-9c7b-608da8fc095b tempest-CinderUnicodeTest-364423762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.026s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:25:42 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-21992228-83ce-4eb3-9c7b-608da8fc095b tempest-CinderUnicodeTest-364423762 None] Create snapshot completed successfully Apr 28 19:25:42 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-fdd7c279-a554-465e-bf28-c0001f346d0f tempest-CinderUnicodeTest-364423762 None] Acquiring lock "cinder-5d812ec5-36be-420f-9d52-287044c4df4a-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:25:42 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-fdd7c279-a554-465e-bf28-c0001f346d0f tempest-CinderUnicodeTest-364423762 None] Lock "cinder-5d812ec5-36be-420f-9d52-287044c4df4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:25:42 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-fdd7c279-a554-465e-bf28-c0001f346d0f tempest-CinderUnicodeTest-364423762 None] Acquiring lock "cinder-quobyte-a3466eff-6623-4475-b247-e1e51242a825" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:25:42 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-fdd7c279-a554-465e-bf28-c0001f346d0f tempest-CinderUnicodeTest-364423762 None] Lock "cinder-quobyte-a3466eff-6623-4475-b247-e1e51242a825" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:25:42 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-fdd7c279-a554-465e-bf28-c0001f346d0f tempest-CinderUnicodeTest-364423762 None] Acquiring lock "cinder-quobyte-5d812ec5-36be-420f-9d52-287044c4df4a" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:25:42 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-fdd7c279-a554-465e-bf28-c0001f346d0f tempest-CinderUnicodeTest-364423762 None] Lock "cinder-quobyte-5d812ec5-36be-420f-9d52-287044c4df4a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:25:42 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-fdd7c279-a554-465e-bf28-c0001f346d0f tempest-CinderUnicodeTest-364423762 None] Deleting offline snapshot 5d812ec5-36be-420f-9d52-287044c4df4a of volume a3466eff-6623-4475-b247-e1e51242a825 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 19:25:42 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-fdd7c279-a554-465e-bf28-c0001f346d0f tempest-CinderUnicodeTest-364423762 None] snapshot_file for this snap is: volume-a3466eff-6623-4475-b247-e1e51242a825.5d812ec5-36be-420f-9d52-287044c4df4a {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 19:25:42 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[13be18e6-531d-4cea-8f85-ab891c315e8f]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:25:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fdd7c279-a554-465e-bf28-c0001f346d0f tempest-CinderUnicodeTest-364423762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a3466eff-6623-4475-b247-e1e51242a825.5d812ec5-36be-420f-9d52-287044c4df4a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:42 devstack sudo[93260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a3466eff-6623-4475-b247-e1e51242a825.5d812ec5-36be-420f-9d52-287044c4df4a Apr 28 19:25:42 devstack sudo[93260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:43 devstack sudo[93260]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fdd7c279-a554-465e-bf28-c0001f346d0f tempest-CinderUnicodeTest-364423762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a3466eff-6623-4475-b247-e1e51242a825.5d812ec5-36be-420f-9d52-287044c4df4a" returned: 0 in 0.764s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:43 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-fdd7c279-a554-465e-bf28-c0001f346d0f tempest-CinderUnicodeTest-364423762 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3466eff-6623-4475-b247-e1e51242a825(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:25:43 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f42ab34-a7c0-4e3f-983a-302cec2122fe]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:25:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fdd7c279-a554-465e-bf28-c0001f346d0f tempest-CinderUnicodeTest-364423762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a3466eff-6623-4475-b247-e1e51242a825 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:43 devstack sudo[93266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a3466eff-6623-4475-b247-e1e51242a825 Apr 28 19:25:43 devstack sudo[93266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:43 devstack sudo[93266]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fdd7c279-a554-465e-bf28-c0001f346d0f tempest-CinderUnicodeTest-364423762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a3466eff-6623-4475-b247-e1e51242a825" returned: 0 in 0.728s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fdd7c279-a554-465e-bf28-c0001f346d0f tempest-CinderUnicodeTest-364423762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a3466eff-6623-4475-b247-e1e51242a825.5d812ec5-36be-420f-9d52-287044c4df4a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:43 devstack sudo[93271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a3466eff-6623-4475-b247-e1e51242a825.5d812ec5-36be-420f-9d52-287044c4df4a Apr 28 19:25:43 devstack sudo[93271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:44 devstack sudo[93271]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fdd7c279-a554-465e-bf28-c0001f346d0f tempest-CinderUnicodeTest-364423762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a3466eff-6623-4475-b247-e1e51242a825.5d812ec5-36be-420f-9d52-287044c4df4a" returned: 0 in 0.784s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fdd7c279-a554-465e-bf28-c0001f346d0f tempest-CinderUnicodeTest-364423762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a3466eff-6623-4475-b247-e1e51242a825.5d812ec5-36be-420f-9d52-287044c4df4a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:44 devstack sudo[93278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a3466eff-6623-4475-b247-e1e51242a825.5d812ec5-36be-420f-9d52-287044c4df4a Apr 28 19:25:44 devstack sudo[93278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:45 devstack sudo[93278]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fdd7c279-a554-465e-bf28-c0001f346d0f tempest-CinderUnicodeTest-364423762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a3466eff-6623-4475-b247-e1e51242a825.5d812ec5-36be-420f-9d52-287044c4df4a" returned: 0 in 0.653s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:45 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-fdd7c279-a554-465e-bf28-c0001f346d0f tempest-CinderUnicodeTest-364423762 None] Lock "cinder-quobyte-5d812ec5-36be-420f-9d52-287044c4df4a" released by "_delete_snapshot" :: held 3.047s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:25:45 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-fdd7c279-a554-465e-bf28-c0001f346d0f tempest-CinderUnicodeTest-364423762 None] Lock "cinder-quobyte-a3466eff-6623-4475-b247-e1e51242a825" released by "delete_snapshot" :: held 3.075s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:25:45 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-fdd7c279-a554-465e-bf28-c0001f346d0f tempest-CinderUnicodeTest-364423762 None] Created reservations ['35998f5b-9bf3-4cc2-a997-8d88b0b35b07', '50771eff-4827-45d7-9756-91b95adb362a', '27778ff5-7b28-4487-a3d5-dc4b4d9d2e83', 'ef9ab696-a2c0-4a7c-8ddc-7e6ef3cac246'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:25:45 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-fdd7c279-a554-465e-bf28-c0001f346d0f tempest-CinderUnicodeTest-364423762 None] Delete snapshot completed successfully. Apr 28 19:25:45 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-fdd7c279-a554-465e-bf28-c0001f346d0f tempest-CinderUnicodeTest-364423762 None] Lock "cinder-5d812ec5-36be-420f-9d52-287044c4df4a-delete_snapshot" released by "delete_snapshot" :: held 3.219s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:25:46 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7e29fd40-dccc-4bc8-b469-187599334646 tempest-CinderUnicodeTest-364423762 None] Acquiring lock "cinder-a3466eff-6623-4475-b247-e1e51242a825-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:25:46 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7e29fd40-dccc-4bc8-b469-187599334646 tempest-CinderUnicodeTest-364423762 None] Lock "cinder-a3466eff-6623-4475-b247-e1e51242a825-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:25:46 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7e29fd40-dccc-4bc8-b469-187599334646 tempest-CinderUnicodeTest-364423762 None] Acquiring lock "cinder-quobyte-a3466eff-6623-4475-b247-e1e51242a825" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:25:46 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7e29fd40-dccc-4bc8-b469-187599334646 tempest-CinderUnicodeTest-364423762 None] Lock "cinder-quobyte-a3466eff-6623-4475-b247-e1e51242a825" acquired by "delete_volume" :: waited 0.016s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:25:46 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f105e57f-d0cf-4be3-8314-b98a1b30ca4b]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:25:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7e29fd40-dccc-4bc8-b469-187599334646 tempest-CinderUnicodeTest-364423762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a3466eff-6623-4475-b247-e1e51242a825 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:46 devstack sudo[93287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a3466eff-6623-4475-b247-e1e51242a825 Apr 28 19:25:46 devstack sudo[93287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:47 devstack sudo[93287]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7e29fd40-dccc-4bc8-b469-187599334646 tempest-CinderUnicodeTest-364423762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a3466eff-6623-4475-b247-e1e51242a825" returned: 0 in 0.793s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7e29fd40-dccc-4bc8-b469-187599334646 tempest-CinderUnicodeTest-364423762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a3466eff-6623-4475-b247-e1e51242a825 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:47 devstack sudo[93293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a3466eff-6623-4475-b247-e1e51242a825 Apr 28 19:25:47 devstack sudo[93293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:48 devstack sudo[93293]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7e29fd40-dccc-4bc8-b469-187599334646 tempest-CinderUnicodeTest-364423762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-a3466eff-6623-4475-b247-e1e51242a825" returned: 0 in 0.727s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:48 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7e29fd40-dccc-4bc8-b469-187599334646 tempest-CinderUnicodeTest-364423762 None] Lock "cinder-quobyte-a3466eff-6623-4475-b247-e1e51242a825" released by "delete_volume" :: held 1.589s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:25:48 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-7e29fd40-dccc-4bc8-b469-187599334646 tempest-CinderUnicodeTest-364423762 None] Created reservations ['56fda06d-d7b9-4607-a865-0d6764622b9f', '33d81b6b-bce3-4676-97d9-ea1b3924ec39', '483dedb5-1511-44f8-8be1-f5f7ad3b2cbe', '12ff2aa7-692c-4aa9-883c-b93fc5daa60c'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:25:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7e29fd40-dccc-4bc8-b469-187599334646 tempest-CinderUnicodeTest-364423762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:25:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7e29fd40-dccc-4bc8-b469-187599334646 tempest-CinderUnicodeTest-364423762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:25:48 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7e29fd40-dccc-4bc8-b469-187599334646 tempest-CinderUnicodeTest-364423762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:25:48 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7e29fd40-dccc-4bc8-b469-187599334646 tempest-CinderUnicodeTest-364423762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:25:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7e29fd40-dccc-4bc8-b469-187599334646 tempest-CinderUnicodeTest-364423762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:25:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7e29fd40-dccc-4bc8-b469-187599334646 tempest-CinderUnicodeTest-364423762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:48 devstack sudo[93297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:25:48 devstack sudo[93297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:48 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-adfd1b53-b487-4b83-be17-9454a27f5349 tempest-CinderUnicodeTest-364423762 None] Acquiring lock "cinder-6165acb1-d4fa-40e8-9e2e-bd0709bb8705-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:25:48 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-adfd1b53-b487-4b83-be17-9454a27f5349 tempest-CinderUnicodeTest-364423762 None] Lock "cinder-6165acb1-d4fa-40e8-9e2e-bd0709bb8705-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:25:48 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-adfd1b53-b487-4b83-be17-9454a27f5349 tempest-CinderUnicodeTest-364423762 None] Acquiring lock "cinder-quobyte-6165acb1-d4fa-40e8-9e2e-bd0709bb8705" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:25:48 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-adfd1b53-b487-4b83-be17-9454a27f5349 tempest-CinderUnicodeTest-364423762 None] Lock "cinder-quobyte-6165acb1-d4fa-40e8-9e2e-bd0709bb8705" acquired by "delete_volume" :: waited 0.020s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:25:48 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9aa6bf5-4ddb-49f2-bd37-db970d07a3fc]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:25:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-adfd1b53-b487-4b83-be17-9454a27f5349 tempest-CinderUnicodeTest-364423762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6165acb1-d4fa-40e8-9e2e-bd0709bb8705 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:49 devstack sudo[93297]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7e29fd40-dccc-4bc8-b469-187599334646 tempest-CinderUnicodeTest-364423762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.709s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:49 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-7e29fd40-dccc-4bc8-b469-187599334646 tempest-CinderUnicodeTest-364423762 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:25:49 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-7e29fd40-dccc-4bc8-b469-187599334646 tempest-CinderUnicodeTest-364423762 None] Deleted volume successfully. Apr 28 19:25:49 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7e29fd40-dccc-4bc8-b469-187599334646 tempest-CinderUnicodeTest-364423762 None] Lock "cinder-a3466eff-6623-4475-b247-e1e51242a825-delete_volume" released by "delete_volume" :: held 2.509s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:25:49 devstack sudo[93301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6165acb1-d4fa-40e8-9e2e-bd0709bb8705 Apr 28 19:25:49 devstack sudo[93301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:49 devstack sudo[93301]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-adfd1b53-b487-4b83-be17-9454a27f5349 tempest-CinderUnicodeTest-364423762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6165acb1-d4fa-40e8-9e2e-bd0709bb8705" returned: 0 in 0.787s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-adfd1b53-b487-4b83-be17-9454a27f5349 tempest-CinderUnicodeTest-364423762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6165acb1-d4fa-40e8-9e2e-bd0709bb8705 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:49 devstack sudo[93306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6165acb1-d4fa-40e8-9e2e-bd0709bb8705 Apr 28 19:25:49 devstack sudo[93306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:50 devstack sudo[93306]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-adfd1b53-b487-4b83-be17-9454a27f5349 tempest-CinderUnicodeTest-364423762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-6165acb1-d4fa-40e8-9e2e-bd0709bb8705" returned: 0 in 0.650s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:50 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-adfd1b53-b487-4b83-be17-9454a27f5349 tempest-CinderUnicodeTest-364423762 None] Lock "cinder-quobyte-6165acb1-d4fa-40e8-9e2e-bd0709bb8705" released by "delete_volume" :: held 1.499s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:25:50 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-adfd1b53-b487-4b83-be17-9454a27f5349 tempest-CinderUnicodeTest-364423762 None] Created reservations ['f3834a80-43eb-4633-bd04-e75621145758', 'b0dc1239-0ce6-4cf8-b448-4b201ddf6bc0', 'e7438da1-4502-4239-ad5c-ccbdce9a21b0', 'e9b8b103-df21-4d31-a798-48cb0fb386bc'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:25:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-adfd1b53-b487-4b83-be17-9454a27f5349 tempest-CinderUnicodeTest-364423762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:25:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-adfd1b53-b487-4b83-be17-9454a27f5349 tempest-CinderUnicodeTest-364423762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:25:50 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-adfd1b53-b487-4b83-be17-9454a27f5349 tempest-CinderUnicodeTest-364423762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:25:50 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-adfd1b53-b487-4b83-be17-9454a27f5349 tempest-CinderUnicodeTest-364423762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:25:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-adfd1b53-b487-4b83-be17-9454a27f5349 tempest-CinderUnicodeTest-364423762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:25:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-adfd1b53-b487-4b83-be17-9454a27f5349 tempest-CinderUnicodeTest-364423762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:25:50 devstack sudo[93309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:25:50 devstack sudo[93309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:25:51 devstack sudo[93309]: pam_unix(sudo:session): session closed for user root Apr 28 19:25:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-adfd1b53-b487-4b83-be17-9454a27f5349 tempest-CinderUnicodeTest-364423762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.614s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:25:51 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-adfd1b53-b487-4b83-be17-9454a27f5349 tempest-CinderUnicodeTest-364423762 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:25:51 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-adfd1b53-b487-4b83-be17-9454a27f5349 tempest-CinderUnicodeTest-364423762 None] Deleted volume successfully. Apr 28 19:25:51 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-adfd1b53-b487-4b83-be17-9454a27f5349 tempest-CinderUnicodeTest-364423762 None] Lock "cinder-6165acb1-d4fa-40e8-9e2e-bd0709bb8705-delete_volume" released by "delete_volume" :: held 2.362s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:26:00 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:SELECT=101,cinder:UPDATE=137,cinder:INSERT=33,cinder:DELETE=13 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 19:26:01 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:SELECT=99,cinder:INSERT=34,cinder:UPDATE=132,cinder:DELETE=10 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 19:26:02 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-9790251c-8265-4c03-80cf-836399bf649b tempest-CreateVolumesFromSnapshotTest-899706040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:26:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9790251c-8265-4c03-80cf-836399bf649b tempest-CreateVolumesFromSnapshotTest-899706040 None] Flow 'volume_create_manager' (f3526214-e76d-4910-9054-6098614637c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:26:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9790251c-8265-4c03-80cf-836399bf649b tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (448399fa-19e9-49b4-bb31-84b10faae55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9790251c-8265-4c03-80cf-836399bf649b tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (448399fa-19e9-49b4-bb31-84b10faae55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-779300098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55e921c8-a5a8-4714-ba18-2d0439daf197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec9c30e85d743d1bebeb058dbf67aff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:26:02Z,use_quota=True,user_id='6368d1e0ff4b4d2e9057b330a940de2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9790251c-8265-4c03-80cf-836399bf649b tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e46fedd-cc63-4583-b741-63652cc6e24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9790251c-8265-4c03-80cf-836399bf649b tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e46fedd-cc63-4583-b741-63652cc6e24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9790251c-8265-4c03-80cf-836399bf649b tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eac23c7-3a03-4602-b176-90dd9000327b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9790251c-8265-4c03-80cf-836399bf649b tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eac23c7-3a03-4602-b176-90dd9000327b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55e921c8-a5a8-4714-ba18-2d0439daf197', 'volume_name': 'volume-55e921c8-a5a8-4714-ba18-2d0439daf197', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9790251c-8265-4c03-80cf-836399bf649b tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8e569bf-5494-4cd7-a207-5f4f95776704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9790251c-8265-4c03-80cf-836399bf649b tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8e569bf-5494-4cd7-a207-5f4f95776704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9790251c-8265-4c03-80cf-836399bf649b tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac809957-caf0-407c-90de-1850362db536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:02 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-9790251c-8265-4c03-80cf-836399bf649b tempest-CreateVolumesFromSnapshotTest-899706040 None] Volume 55e921c8-a5a8-4714-ba18-2d0439daf197: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55e921c8-a5a8-4714-ba18-2d0439daf197', 'volume_size': 1} Apr 28 19:26:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9790251c-8265-4c03-80cf-836399bf649b tempest-CreateVolumesFromSnapshotTest-899706040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9790251c-8265-4c03-80cf-836399bf649b tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:02 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-9790251c-8265-4c03-80cf-836399bf649b tempest-CreateVolumesFromSnapshotTest-899706040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-779300098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55e921c8-a5a8-4714-ba18-2d0439daf197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec9c30e85d743d1bebeb058dbf67aff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:26:02Z,use_quota=True,user_id='6368d1e0ff4b4d2e9057b330a940de2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:26:02 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-9790251c-8265-4c03-80cf-836399bf649b tempest-CreateVolumesFromSnapshotTest-899706040 None] Creating volume 55e921c8-a5a8-4714-ba18-2d0439daf197 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:26:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9790251c-8265-4c03-80cf-836399bf649b tempest-CreateVolumesFromSnapshotTest-899706040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9790251c-8265-4c03-80cf-836399bf649b tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:02 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-9790251c-8265-4c03-80cf-836399bf649b tempest-CreateVolumesFromSnapshotTest-899706040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:26:02 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-9790251c-8265-4c03-80cf-836399bf649b tempest-CreateVolumesFromSnapshotTest-899706040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:26:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9790251c-8265-4c03-80cf-836399bf649b tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:02 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-9790251c-8265-4c03-80cf-836399bf649b tempest-CreateVolumesFromSnapshotTest-899706040 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:26:02 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-9790251c-8265-4c03-80cf-836399bf649b tempest-CreateVolumesFromSnapshotTest-899706040 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:26:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9790251c-8265-4c03-80cf-836399bf649b tempest-CreateVolumesFromSnapshotTest-899706040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55e921c8-a5a8-4714-ba18-2d0439daf197 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:02 devstack sudo[93356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55e921c8-a5a8-4714-ba18-2d0439daf197 1073741824 Apr 28 19:26:02 devstack sudo[93356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:02 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-abdd53a9-b0a8-42d4-91cf-81b5580330db tempest-VolumeDependencyTests-637805770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:26:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-abdd53a9-b0a8-42d4-91cf-81b5580330db tempest-VolumeDependencyTests-637805770 None] Flow 'volume_create_manager' (d788674a-4286-4ad0-a2a8-5f68d28be30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:26:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-abdd53a9-b0a8-42d4-91cf-81b5580330db tempest-VolumeDependencyTests-637805770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c316baad-ca58-4452-87a1-129ff60ef0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-abdd53a9-b0a8-42d4-91cf-81b5580330db tempest-VolumeDependencyTests-637805770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c316baad-ca58-4452-87a1-129ff60ef0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1540975875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e72a8fc1-2ab4-4355-8247-f42ab18d2f45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dec47550fdfb4870b6e7667d4a4ef673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:26:02Z,use_quota=True,user_id='4b5be3fcfe14488181e5b7b0cbbb1bde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-abdd53a9-b0a8-42d4-91cf-81b5580330db tempest-VolumeDependencyTests-637805770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf59d7f5-64cd-4d95-8ec6-6228532fe2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-abdd53a9-b0a8-42d4-91cf-81b5580330db tempest-VolumeDependencyTests-637805770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf59d7f5-64cd-4d95-8ec6-6228532fe2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-abdd53a9-b0a8-42d4-91cf-81b5580330db tempest-VolumeDependencyTests-637805770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66ac3bbd-b8f2-44c5-989a-ae759160a9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-abdd53a9-b0a8-42d4-91cf-81b5580330db tempest-VolumeDependencyTests-637805770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66ac3bbd-b8f2-44c5-989a-ae759160a9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e72a8fc1-2ab4-4355-8247-f42ab18d2f45', 'volume_name': 'volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-abdd53a9-b0a8-42d4-91cf-81b5580330db tempest-VolumeDependencyTests-637805770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0532603d-1bfb-4e4f-ad22-d73ffba3ca0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-abdd53a9-b0a8-42d4-91cf-81b5580330db tempest-VolumeDependencyTests-637805770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0532603d-1bfb-4e4f-ad22-d73ffba3ca0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-abdd53a9-b0a8-42d4-91cf-81b5580330db tempest-VolumeDependencyTests-637805770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2367cb52-a05b-42f4-b320-5099acbcd218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:02 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-abdd53a9-b0a8-42d4-91cf-81b5580330db tempest-VolumeDependencyTests-637805770 None] Volume e72a8fc1-2ab4-4355-8247-f42ab18d2f45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45', 'volume_size': 1} Apr 28 19:26:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-abdd53a9-b0a8-42d4-91cf-81b5580330db tempest-VolumeDependencyTests-637805770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:02 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-f739d463-4511-45ff-9dce-e397cc9c2f6c tempest-CreateVolumesFromImageTest-1883144102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:26:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f739d463-4511-45ff-9dce-e397cc9c2f6c tempest-CreateVolumesFromImageTest-1883144102 None] Flow 'volume_create_manager' (0e6fe4d6-af8e-489c-9962-400a0f5d68a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:26:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f739d463-4511-45ff-9dce-e397cc9c2f6c tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebf4f4b4-50ac-4ee5-bdd7-7b3a2ca2f5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f739d463-4511-45ff-9dce-e397cc9c2f6c tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebf4f4b4-50ac-4ee5-bdd7-7b3a2ca2f5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1794790544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe1316e8-1a63-4d95-8120-70cd4d93df8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='280cf4e5bbb143d6839481ad0b569d07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:26:03Z,use_quota=True,user_id='67aaab913da8415598479a5c3d281591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f739d463-4511-45ff-9dce-e397cc9c2f6c tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eec7c6cf-9a92-4cea-96bd-ac3c902e8d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f739d463-4511-45ff-9dce-e397cc9c2f6c tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eec7c6cf-9a92-4cea-96bd-ac3c902e8d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f739d463-4511-45ff-9dce-e397cc9c2f6c tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b274c15f-427a-4f4f-9d2c-5776b0162f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f739d463-4511-45ff-9dce-e397cc9c2f6c tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b274c15f-427a-4f4f-9d2c-5776b0162f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe1316e8-1a63-4d95-8120-70cd4d93df8c', 'volume_name': 'volume-fe1316e8-1a63-4d95-8120-70cd4d93df8c', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f739d463-4511-45ff-9dce-e397cc9c2f6c tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d835e18f-d16d-43fc-9f8e-91a86263c386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f739d463-4511-45ff-9dce-e397cc9c2f6c tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d835e18f-d16d-43fc-9f8e-91a86263c386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f739d463-4511-45ff-9dce-e397cc9c2f6c tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (449a14d3-392d-4e78-acff-87374ad89c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:02 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-f739d463-4511-45ff-9dce-e397cc9c2f6c tempest-CreateVolumesFromImageTest-1883144102 None] Volume fe1316e8-1a63-4d95-8120-70cd4d93df8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe1316e8-1a63-4d95-8120-70cd4d93df8c', 'volume_size': 1} Apr 28 19:26:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f739d463-4511-45ff-9dce-e397cc9c2f6c tempest-CreateVolumesFromImageTest-1883144102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:03 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-5543acef-f541-44c9-a673-6b02baca9e8c tempest-CreateVolumesFromImageTest-1883144102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:26:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5543acef-f541-44c9-a673-6b02baca9e8c tempest-CreateVolumesFromImageTest-1883144102 None] Flow 'volume_create_manager' (b8bdda02-11e1-44d1-be79-527891609404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:26:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5543acef-f541-44c9-a673-6b02baca9e8c tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a5255c9-39b6-4184-aa64-2d4e75a52ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:03 devstack sudo[93356]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5543acef-f541-44c9-a673-6b02baca9e8c tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a5255c9-39b6-4184-aa64-2d4e75a52ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1273127087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff40ab43-7121-439b-88e0-03b6d51b3cf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='280cf4e5bbb143d6839481ad0b569d07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:26:03Z,use_quota=True,user_id='67aaab913da8415598479a5c3d281591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5543acef-f541-44c9-a673-6b02baca9e8c tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e985096-fb7b-43e8-b9d1-6638ec1cd28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5543acef-f541-44c9-a673-6b02baca9e8c tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e985096-fb7b-43e8-b9d1-6638ec1cd28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5543acef-f541-44c9-a673-6b02baca9e8c tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c02e9265-182c-4288-8bd2-5f7d79400b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5543acef-f541-44c9-a673-6b02baca9e8c tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c02e9265-182c-4288-8bd2-5f7d79400b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff40ab43-7121-439b-88e0-03b6d51b3cf9', 'volume_name': 'volume-ff40ab43-7121-439b-88e0-03b6d51b3cf9', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5543acef-f541-44c9-a673-6b02baca9e8c tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba856cec-30a0-404c-bc7a-64f75acf17b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5543acef-f541-44c9-a673-6b02baca9e8c tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba856cec-30a0-404c-bc7a-64f75acf17b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5543acef-f541-44c9-a673-6b02baca9e8c tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a87297dc-7b71-4497-8939-ed4771993e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:03 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-5543acef-f541-44c9-a673-6b02baca9e8c tempest-CreateVolumesFromImageTest-1883144102 None] Volume ff40ab43-7121-439b-88e0-03b6d51b3cf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff40ab43-7121-439b-88e0-03b6d51b3cf9', 'volume_size': 1} Apr 28 19:26:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5543acef-f541-44c9-a673-6b02baca9e8c tempest-CreateVolumesFromImageTest-1883144102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9790251c-8265-4c03-80cf-836399bf649b tempest-CreateVolumesFromSnapshotTest-899706040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55e921c8-a5a8-4714-ba18-2d0439daf197 1073741824" returned: 0 in 1.086s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9790251c-8265-4c03-80cf-836399bf649b tempest-CreateVolumesFromSnapshotTest-899706040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55e921c8-a5a8-4714-ba18-2d0439daf197 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:03 devstack sudo[93362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55e921c8-a5a8-4714-ba18-2d0439daf197 Apr 28 19:26:03 devstack sudo[93362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:03 devstack cinder-volume[83863]: DEBUG oslo_service.periodic_task [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 28 19:26:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:26:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:26:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:03 devstack sudo[93364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:26:03 devstack sudo[93364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:03 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-4621124c-31c8-4953-b3e1-77004231fd71 tempest-CreateVolumesFromImageTest-1883144102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:26:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4621124c-31c8-4953-b3e1-77004231fd71 tempest-CreateVolumesFromImageTest-1883144102 None] Flow 'volume_create_manager' (84343043-f161-45d6-ba5b-29731d8c732e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:26:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4621124c-31c8-4953-b3e1-77004231fd71 tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa1051c2-7d8c-4b13-b7b4-fdaad2ad3b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4621124c-31c8-4953-b3e1-77004231fd71 tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa1051c2-7d8c-4b13-b7b4-fdaad2ad3b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-730459363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b98d68f-84cc-41a7-b07f-5bcc23103499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='280cf4e5bbb143d6839481ad0b569d07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:26:04Z,use_quota=True,user_id='67aaab913da8415598479a5c3d281591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4621124c-31c8-4953-b3e1-77004231fd71 tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5afa6f7f-ec41-44a9-b0b8-9a61529bb827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4621124c-31c8-4953-b3e1-77004231fd71 tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5afa6f7f-ec41-44a9-b0b8-9a61529bb827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4621124c-31c8-4953-b3e1-77004231fd71 tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6cfbdb7-c41e-4105-9f36-8aa0c0fc6dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4621124c-31c8-4953-b3e1-77004231fd71 tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6cfbdb7-c41e-4105-9f36-8aa0c0fc6dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b98d68f-84cc-41a7-b07f-5bcc23103499', 'volume_name': 'volume-7b98d68f-84cc-41a7-b07f-5bcc23103499', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4621124c-31c8-4953-b3e1-77004231fd71 tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (167e8f2d-84ec-4524-9a83-41a4d3dfbbcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4621124c-31c8-4953-b3e1-77004231fd71 tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (167e8f2d-84ec-4524-9a83-41a4d3dfbbcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4621124c-31c8-4953-b3e1-77004231fd71 tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2153a0b9-312d-4f0e-ae1a-da86e364aed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:03 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-4621124c-31c8-4953-b3e1-77004231fd71 tempest-CreateVolumesFromImageTest-1883144102 None] Volume 7b98d68f-84cc-41a7-b07f-5bcc23103499: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b98d68f-84cc-41a7-b07f-5bcc23103499', 'volume_size': 1} Apr 28 19:26:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4621124c-31c8-4953-b3e1-77004231fd71 tempest-CreateVolumesFromImageTest-1883144102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:04 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-daa9dc4d-a72f-4b6a-a969-c0ed6d19d10d tempest-CreateVolumesFromImageTest-1883144102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:26:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-daa9dc4d-a72f-4b6a-a969-c0ed6d19d10d tempest-CreateVolumesFromImageTest-1883144102 None] Flow 'volume_create_manager' (e8b0c127-e83d-4c1c-a90f-e29ff9378647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:26:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-daa9dc4d-a72f-4b6a-a969-c0ed6d19d10d tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98de9fb8-e74f-41e1-9428-195eab42c52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-daa9dc4d-a72f-4b6a-a969-c0ed6d19d10d tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98de9fb8-e74f-41e1-9428-195eab42c52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1747021929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b88301-7d95-43a7-bfda-dd68d2bacfbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='280cf4e5bbb143d6839481ad0b569d07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:26:04Z,use_quota=True,user_id='67aaab913da8415598479a5c3d281591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-daa9dc4d-a72f-4b6a-a969-c0ed6d19d10d tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (947011a2-25de-44a8-b31c-51e1c5c4ccce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:04 devstack sudo[93362]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-daa9dc4d-a72f-4b6a-a969-c0ed6d19d10d tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (947011a2-25de-44a8-b31c-51e1c5c4ccce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-daa9dc4d-a72f-4b6a-a969-c0ed6d19d10d tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce22d9c3-4d10-4995-bc78-dfbc620f963d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-daa9dc4d-a72f-4b6a-a969-c0ed6d19d10d tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce22d9c3-4d10-4995-bc78-dfbc620f963d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72b88301-7d95-43a7-bfda-dd68d2bacfbf', 'volume_name': 'volume-72b88301-7d95-43a7-bfda-dd68d2bacfbf', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-daa9dc4d-a72f-4b6a-a969-c0ed6d19d10d tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18a0636c-f19c-49e0-bd7b-3d8b619095de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-daa9dc4d-a72f-4b6a-a969-c0ed6d19d10d tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18a0636c-f19c-49e0-bd7b-3d8b619095de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-daa9dc4d-a72f-4b6a-a969-c0ed6d19d10d tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3526f7a9-7816-430e-940e-558412f691c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:04 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-daa9dc4d-a72f-4b6a-a969-c0ed6d19d10d tempest-CreateVolumesFromImageTest-1883144102 None] Volume 72b88301-7d95-43a7-bfda-dd68d2bacfbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72b88301-7d95-43a7-bfda-dd68d2bacfbf', 'volume_size': 1} Apr 28 19:26:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-daa9dc4d-a72f-4b6a-a969-c0ed6d19d10d tempest-CreateVolumesFromImageTest-1883144102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9790251c-8265-4c03-80cf-836399bf649b tempest-CreateVolumesFromSnapshotTest-899706040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55e921c8-a5a8-4714-ba18-2d0439daf197" returned: 0 in 0.848s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:04 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-9790251c-8265-4c03-80cf-836399bf649b tempest-CreateVolumesFromSnapshotTest-899706040 None] <== create_volume: return (1988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:26:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9790251c-8265-4c03-80cf-836399bf649b tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.990s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-abdd53a9-b0a8-42d4-91cf-81b5580330db tempest-VolumeDependencyTests-637805770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.809s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:04 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-abdd53a9-b0a8-42d4-91cf-81b5580330db tempest-VolumeDependencyTests-637805770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1540975875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e72a8fc1-2ab4-4355-8247-f42ab18d2f45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dec47550fdfb4870b6e7667d4a4ef673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:26:02Z,use_quota=True,user_id='4b5be3fcfe14488181e5b7b0cbbb1bde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:26:04 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-abdd53a9-b0a8-42d4-91cf-81b5580330db tempest-VolumeDependencyTests-637805770 None] Creating volume e72a8fc1-2ab4-4355-8247-f42ab18d2f45 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:26:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-abdd53a9-b0a8-42d4-91cf-81b5580330db tempest-VolumeDependencyTests-637805770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-abdd53a9-b0a8-42d4-91cf-81b5580330db tempest-VolumeDependencyTests-637805770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:04 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-abdd53a9-b0a8-42d4-91cf-81b5580330db tempest-VolumeDependencyTests-637805770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:26:04 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-abdd53a9-b0a8-42d4-91cf-81b5580330db tempest-VolumeDependencyTests-637805770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:26:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-abdd53a9-b0a8-42d4-91cf-81b5580330db tempest-VolumeDependencyTests-637805770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:04 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-abdd53a9-b0a8-42d4-91cf-81b5580330db tempest-VolumeDependencyTests-637805770 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:26:04 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-abdd53a9-b0a8-42d4-91cf-81b5580330db tempest-VolumeDependencyTests-637805770 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:26:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-abdd53a9-b0a8-42d4-91cf-81b5580330db tempest-VolumeDependencyTests-637805770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9790251c-8265-4c03-80cf-836399bf649b tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac809957-caf0-407c-90de-1850362db536) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55e921c8-a5a8-4714-ba18-2d0439daf197', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9790251c-8265-4c03-80cf-836399bf649b tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25db7405-9811-4983-8aac-3267acd1a319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:04 devstack sudo[93367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45 1073741824 Apr 28 19:26:04 devstack sudo[93367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:04 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-9790251c-8265-4c03-80cf-836399bf649b tempest-CreateVolumesFromSnapshotTest-899706040 None] Volume volume-55e921c8-a5a8-4714-ba18-2d0439daf197 (55e921c8-a5a8-4714-ba18-2d0439daf197): created successfully Apr 28 19:26:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9790251c-8265-4c03-80cf-836399bf649b tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25db7405-9811-4983-8aac-3267acd1a319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9790251c-8265-4c03-80cf-836399bf649b tempest-CreateVolumesFromSnapshotTest-899706040 None] Flow 'volume_create_manager' (f3526214-e76d-4910-9054-6098614637c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:26:04 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-9790251c-8265-4c03-80cf-836399bf649b tempest-CreateVolumesFromSnapshotTest-899706040 None] Created volume successfully. Apr 28 19:26:04 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-025229b2-0a02-4264-8cba-4969d4a75301 tempest-CreateVolumesFromImageTest-1883144102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:26:04 devstack sudo[93364]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-025229b2-0a02-4264-8cba-4969d4a75301 tempest-CreateVolumesFromImageTest-1883144102 None] Flow 'volume_create_manager' (fc40f120-4c37-4fd5-b897-426e1524e62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:26:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-025229b2-0a02-4264-8cba-4969d4a75301 tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2a6878b-56c1-485f-ab6d-0520d1f46d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 1.054s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:04 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:26:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-025229b2-0a02-4264-8cba-4969d4a75301 tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2a6878b-56c1-485f-ab6d-0520d1f46d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1433184745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b348510a-c2a5-46aa-8a56-939c6f803727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='280cf4e5bbb143d6839481ad0b569d07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:26:04Z,use_quota=True,user_id='67aaab913da8415598479a5c3d281591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-025229b2-0a02-4264-8cba-4969d4a75301 tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fe0e259-8532-45f1-9446-e904e67cfafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-025229b2-0a02-4264-8cba-4969d4a75301 tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fe0e259-8532-45f1-9446-e904e67cfafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-025229b2-0a02-4264-8cba-4969d4a75301 tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a627f1e0-06ad-4605-b849-393e3490b2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-025229b2-0a02-4264-8cba-4969d4a75301 tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a627f1e0-06ad-4605-b849-393e3490b2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b348510a-c2a5-46aa-8a56-939c6f803727', 'volume_name': 'volume-b348510a-c2a5-46aa-8a56-939c6f803727', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-025229b2-0a02-4264-8cba-4969d4a75301 tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef1b0f37-e157-4949-81a2-b03258883707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-025229b2-0a02-4264-8cba-4969d4a75301 tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef1b0f37-e157-4949-81a2-b03258883707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-025229b2-0a02-4264-8cba-4969d4a75301 tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d932153-3a21-4f93-8d5c-2e7dec1e80e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:04 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-025229b2-0a02-4264-8cba-4969d4a75301 tempest-CreateVolumesFromImageTest-1883144102 None] Volume b348510a-c2a5-46aa-8a56-939c6f803727: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b348510a-c2a5-46aa-8a56-939c6f803727', 'volume_size': 1} Apr 28 19:26:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-025229b2-0a02-4264-8cba-4969d4a75301 tempest-CreateVolumesFromImageTest-1883144102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:05 devstack sudo[93367]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-abdd53a9-b0a8-42d4-91cf-81b5580330db tempest-VolumeDependencyTests-637805770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45 1073741824" returned: 0 in 0.940s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-abdd53a9-b0a8-42d4-91cf-81b5580330db tempest-VolumeDependencyTests-637805770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:05 devstack sudo[93373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45 Apr 28 19:26:05 devstack sudo[93373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a754a3a4-c49e-4e0e-8a68-2fa9f7c761b2 tempest-CreateVolumesFromSnapshotTest-899706040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:05 devstack sudo[93373]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-abdd53a9-b0a8-42d4-91cf-81b5580330db tempest-VolumeDependencyTests-637805770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45" returned: 0 in 0.704s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:05 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-abdd53a9-b0a8-42d4-91cf-81b5580330db tempest-VolumeDependencyTests-637805770 None] <== create_volume: return (1702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:26:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-abdd53a9-b0a8-42d4-91cf-81b5580330db tempest-VolumeDependencyTests-637805770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f739d463-4511-45ff-9dce-e397cc9c2f6c tempest-CreateVolumesFromImageTest-1883144102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.194s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:05 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f739d463-4511-45ff-9dce-e397cc9c2f6c tempest-CreateVolumesFromImageTest-1883144102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1794790544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe1316e8-1a63-4d95-8120-70cd4d93df8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='280cf4e5bbb143d6839481ad0b569d07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:26:03Z,use_quota=True,user_id='67aaab913da8415598479a5c3d281591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:26:05 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-f739d463-4511-45ff-9dce-e397cc9c2f6c tempest-CreateVolumesFromImageTest-1883144102 None] Creating volume fe1316e8-1a63-4d95-8120-70cd4d93df8c {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:26:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f739d463-4511-45ff-9dce-e397cc9c2f6c tempest-CreateVolumesFromImageTest-1883144102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f739d463-4511-45ff-9dce-e397cc9c2f6c tempest-CreateVolumesFromImageTest-1883144102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:05 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f739d463-4511-45ff-9dce-e397cc9c2f6c tempest-CreateVolumesFromImageTest-1883144102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:26:05 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f739d463-4511-45ff-9dce-e397cc9c2f6c tempest-CreateVolumesFromImageTest-1883144102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:26:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f739d463-4511-45ff-9dce-e397cc9c2f6c tempest-CreateVolumesFromImageTest-1883144102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:05 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f739d463-4511-45ff-9dce-e397cc9c2f6c tempest-CreateVolumesFromImageTest-1883144102 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:26:05 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-f739d463-4511-45ff-9dce-e397cc9c2f6c tempest-CreateVolumesFromImageTest-1883144102 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:26:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f739d463-4511-45ff-9dce-e397cc9c2f6c tempest-CreateVolumesFromImageTest-1883144102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fe1316e8-1a63-4d95-8120-70cd4d93df8c 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:05 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-abdd53a9-b0a8-42d4-91cf-81b5580330db tempest-VolumeDependencyTests-637805770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2367cb52-a05b-42f4-b320-5099acbcd218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:05 devstack sudo[93376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fe1316e8-1a63-4d95-8120-70cd4d93df8c 1073741824 Apr 28 19:26:05 devstack sudo[93376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:05 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-abdd53a9-b0a8-42d4-91cf-81b5580330db tempest-VolumeDependencyTests-637805770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d6e58df-ff7f-474b-aee9-2f459ac03b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:05 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-abdd53a9-b0a8-42d4-91cf-81b5580330db tempest-VolumeDependencyTests-637805770 None] Volume volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45 (e72a8fc1-2ab4-4355-8247-f42ab18d2f45): created successfully Apr 28 19:26:05 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-abdd53a9-b0a8-42d4-91cf-81b5580330db tempest-VolumeDependencyTests-637805770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d6e58df-ff7f-474b-aee9-2f459ac03b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:05 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-abdd53a9-b0a8-42d4-91cf-81b5580330db tempest-VolumeDependencyTests-637805770 None] Flow 'volume_create_manager' (d788674a-4286-4ad0-a2a8-5f68d28be30d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:26:05 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-abdd53a9-b0a8-42d4-91cf-81b5580330db tempest-VolumeDependencyTests-637805770 None] Created volume successfully. Apr 28 19:26:06 devstack sudo[93376]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f739d463-4511-45ff-9dce-e397cc9c2f6c tempest-CreateVolumesFromImageTest-1883144102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fe1316e8-1a63-4d95-8120-70cd4d93df8c 1073741824" returned: 0 in 0.878s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f739d463-4511-45ff-9dce-e397cc9c2f6c tempest-CreateVolumesFromImageTest-1883144102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fe1316e8-1a63-4d95-8120-70cd4d93df8c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-84c75b89-40c4-4863-8983-637bdfdcaebe tempest-VolumeDependencyTests-637805770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:06 devstack sudo[93382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fe1316e8-1a63-4d95-8120-70cd4d93df8c Apr 28 19:26:06 devstack sudo[93382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:07 devstack sudo[93382]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f739d463-4511-45ff-9dce-e397cc9c2f6c tempest-CreateVolumesFromImageTest-1883144102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fe1316e8-1a63-4d95-8120-70cd4d93df8c" returned: 0 in 0.674s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:07 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f739d463-4511-45ff-9dce-e397cc9c2f6c tempest-CreateVolumesFromImageTest-1883144102 None] <== create_volume: return (1614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:26:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f739d463-4511-45ff-9dce-e397cc9c2f6c tempest-CreateVolumesFromImageTest-1883144102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.617s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5543acef-f541-44c9-a673-6b02baca9e8c tempest-CreateVolumesFromImageTest-1883144102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.223s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:07 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5543acef-f541-44c9-a673-6b02baca9e8c tempest-CreateVolumesFromImageTest-1883144102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1273127087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff40ab43-7121-439b-88e0-03b6d51b3cf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='280cf4e5bbb143d6839481ad0b569d07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:26:03Z,use_quota=True,user_id='67aaab913da8415598479a5c3d281591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:26:07 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-5543acef-f541-44c9-a673-6b02baca9e8c tempest-CreateVolumesFromImageTest-1883144102 None] Creating volume ff40ab43-7121-439b-88e0-03b6d51b3cf9 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:26:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5543acef-f541-44c9-a673-6b02baca9e8c tempest-CreateVolumesFromImageTest-1883144102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5543acef-f541-44c9-a673-6b02baca9e8c tempest-CreateVolumesFromImageTest-1883144102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:07 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5543acef-f541-44c9-a673-6b02baca9e8c tempest-CreateVolumesFromImageTest-1883144102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:26:07 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5543acef-f541-44c9-a673-6b02baca9e8c tempest-CreateVolumesFromImageTest-1883144102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:26:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5543acef-f541-44c9-a673-6b02baca9e8c tempest-CreateVolumesFromImageTest-1883144102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:07 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5543acef-f541-44c9-a673-6b02baca9e8c tempest-CreateVolumesFromImageTest-1883144102 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:26:07 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-5543acef-f541-44c9-a673-6b02baca9e8c tempest-CreateVolumesFromImageTest-1883144102 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:26:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5543acef-f541-44c9-a673-6b02baca9e8c tempest-CreateVolumesFromImageTest-1883144102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ff40ab43-7121-439b-88e0-03b6d51b3cf9 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:07 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f739d463-4511-45ff-9dce-e397cc9c2f6c tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (449a14d3-392d-4e78-acff-87374ad89c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe1316e8-1a63-4d95-8120-70cd4d93df8c', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:07 devstack sudo[93385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ff40ab43-7121-439b-88e0-03b6d51b3cf9 1073741824 Apr 28 19:26:07 devstack sudo[93385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:07 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f739d463-4511-45ff-9dce-e397cc9c2f6c tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (833eb354-2814-43a0-81b0-6d63171ad27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:07 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-f739d463-4511-45ff-9dce-e397cc9c2f6c tempest-CreateVolumesFromImageTest-1883144102 None] Volume volume-fe1316e8-1a63-4d95-8120-70cd4d93df8c (fe1316e8-1a63-4d95-8120-70cd4d93df8c): created successfully Apr 28 19:26:07 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f739d463-4511-45ff-9dce-e397cc9c2f6c tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (833eb354-2814-43a0-81b0-6d63171ad27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:07 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f739d463-4511-45ff-9dce-e397cc9c2f6c tempest-CreateVolumesFromImageTest-1883144102 None] Flow 'volume_create_manager' (0e6fe4d6-af8e-489c-9962-400a0f5d68a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:26:07 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-f739d463-4511-45ff-9dce-e397cc9c2f6c tempest-CreateVolumesFromImageTest-1883144102 None] Created volume successfully. Apr 28 19:26:08 devstack sudo[93385]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5543acef-f541-44c9-a673-6b02baca9e8c tempest-CreateVolumesFromImageTest-1883144102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ff40ab43-7121-439b-88e0-03b6d51b3cf9 1073741824" returned: 0 in 0.845s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5543acef-f541-44c9-a673-6b02baca9e8c tempest-CreateVolumesFromImageTest-1883144102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ff40ab43-7121-439b-88e0-03b6d51b3cf9 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:08 devstack sudo[93391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ff40ab43-7121-439b-88e0-03b6d51b3cf9 Apr 28 19:26:08 devstack sudo[93391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:09 devstack sudo[93391]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5543acef-f541-44c9-a673-6b02baca9e8c tempest-CreateVolumesFromImageTest-1883144102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ff40ab43-7121-439b-88e0-03b6d51b3cf9" returned: 0 in 0.709s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:09 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5543acef-f541-44c9-a673-6b02baca9e8c tempest-CreateVolumesFromImageTest-1883144102 None] <== create_volume: return (1598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:26:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5543acef-f541-44c9-a673-6b02baca9e8c tempest-CreateVolumesFromImageTest-1883144102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.601s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4621124c-31c8-4953-b3e1-77004231fd71 tempest-CreateVolumesFromImageTest-1883144102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.307s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:09 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4621124c-31c8-4953-b3e1-77004231fd71 tempest-CreateVolumesFromImageTest-1883144102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-730459363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b98d68f-84cc-41a7-b07f-5bcc23103499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='280cf4e5bbb143d6839481ad0b569d07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:26:04Z,use_quota=True,user_id='67aaab913da8415598479a5c3d281591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:26:09 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-4621124c-31c8-4953-b3e1-77004231fd71 tempest-CreateVolumesFromImageTest-1883144102 None] Creating volume 7b98d68f-84cc-41a7-b07f-5bcc23103499 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:26:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4621124c-31c8-4953-b3e1-77004231fd71 tempest-CreateVolumesFromImageTest-1883144102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4621124c-31c8-4953-b3e1-77004231fd71 tempest-CreateVolumesFromImageTest-1883144102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:09 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4621124c-31c8-4953-b3e1-77004231fd71 tempest-CreateVolumesFromImageTest-1883144102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:26:09 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4621124c-31c8-4953-b3e1-77004231fd71 tempest-CreateVolumesFromImageTest-1883144102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:26:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4621124c-31c8-4953-b3e1-77004231fd71 tempest-CreateVolumesFromImageTest-1883144102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:09 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4621124c-31c8-4953-b3e1-77004231fd71 tempest-CreateVolumesFromImageTest-1883144102 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:26:09 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-4621124c-31c8-4953-b3e1-77004231fd71 tempest-CreateVolumesFromImageTest-1883144102 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:26:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4621124c-31c8-4953-b3e1-77004231fd71 tempest-CreateVolumesFromImageTest-1883144102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7b98d68f-84cc-41a7-b07f-5bcc23103499 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:09 devstack sudo[93394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7b98d68f-84cc-41a7-b07f-5bcc23103499 1073741824 Apr 28 19:26:09 devstack sudo[93394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:09 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5543acef-f541-44c9-a673-6b02baca9e8c tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a87297dc-7b71-4497-8939-ed4771993e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff40ab43-7121-439b-88e0-03b6d51b3cf9', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:09 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5543acef-f541-44c9-a673-6b02baca9e8c tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f3ca45b-5cd6-4c69-81de-e459ea92ee02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:09 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-5543acef-f541-44c9-a673-6b02baca9e8c tempest-CreateVolumesFromImageTest-1883144102 None] Volume volume-ff40ab43-7121-439b-88e0-03b6d51b3cf9 (ff40ab43-7121-439b-88e0-03b6d51b3cf9): created successfully Apr 28 19:26:09 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5543acef-f541-44c9-a673-6b02baca9e8c tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f3ca45b-5cd6-4c69-81de-e459ea92ee02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:09 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5543acef-f541-44c9-a673-6b02baca9e8c tempest-CreateVolumesFromImageTest-1883144102 None] Flow 'volume_create_manager' (b8bdda02-11e1-44d1-be79-527891609404) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:26:09 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-5543acef-f541-44c9-a673-6b02baca9e8c tempest-CreateVolumesFromImageTest-1883144102 None] Created volume successfully. Apr 28 19:26:09 devstack sudo[93394]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4621124c-31c8-4953-b3e1-77004231fd71 tempest-CreateVolumesFromImageTest-1883144102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7b98d68f-84cc-41a7-b07f-5bcc23103499 1073741824" returned: 0 in 0.853s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4621124c-31c8-4953-b3e1-77004231fd71 tempest-CreateVolumesFromImageTest-1883144102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7b98d68f-84cc-41a7-b07f-5bcc23103499 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:10 devstack sudo[93400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7b98d68f-84cc-41a7-b07f-5bcc23103499 Apr 28 19:26:10 devstack sudo[93400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:10 devstack sudo[93400]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4621124c-31c8-4953-b3e1-77004231fd71 tempest-CreateVolumesFromImageTest-1883144102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7b98d68f-84cc-41a7-b07f-5bcc23103499" returned: 0 in 0.602s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:10 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4621124c-31c8-4953-b3e1-77004231fd71 tempest-CreateVolumesFromImageTest-1883144102 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:26:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4621124c-31c8-4953-b3e1-77004231fd71 tempest-CreateVolumesFromImageTest-1883144102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.512s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-daa9dc4d-a72f-4b6a-a969-c0ed6d19d10d tempest-CreateVolumesFromImageTest-1883144102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.455s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:10 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-daa9dc4d-a72f-4b6a-a969-c0ed6d19d10d tempest-CreateVolumesFromImageTest-1883144102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1747021929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b88301-7d95-43a7-bfda-dd68d2bacfbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='280cf4e5bbb143d6839481ad0b569d07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:26:04Z,use_quota=True,user_id='67aaab913da8415598479a5c3d281591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:26:10 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-daa9dc4d-a72f-4b6a-a969-c0ed6d19d10d tempest-CreateVolumesFromImageTest-1883144102 None] Creating volume 72b88301-7d95-43a7-bfda-dd68d2bacfbf {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:26:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-daa9dc4d-a72f-4b6a-a969-c0ed6d19d10d tempest-CreateVolumesFromImageTest-1883144102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-daa9dc4d-a72f-4b6a-a969-c0ed6d19d10d tempest-CreateVolumesFromImageTest-1883144102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:10 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-daa9dc4d-a72f-4b6a-a969-c0ed6d19d10d tempest-CreateVolumesFromImageTest-1883144102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:26:10 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-daa9dc4d-a72f-4b6a-a969-c0ed6d19d10d tempest-CreateVolumesFromImageTest-1883144102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:26:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-daa9dc4d-a72f-4b6a-a969-c0ed6d19d10d tempest-CreateVolumesFromImageTest-1883144102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:10 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-daa9dc4d-a72f-4b6a-a969-c0ed6d19d10d tempest-CreateVolumesFromImageTest-1883144102 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:26:10 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-daa9dc4d-a72f-4b6a-a969-c0ed6d19d10d tempest-CreateVolumesFromImageTest-1883144102 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:26:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-daa9dc4d-a72f-4b6a-a969-c0ed6d19d10d tempest-CreateVolumesFromImageTest-1883144102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-72b88301-7d95-43a7-bfda-dd68d2bacfbf 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4621124c-31c8-4953-b3e1-77004231fd71 tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2153a0b9-312d-4f0e-ae1a-da86e364aed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b98d68f-84cc-41a7-b07f-5bcc23103499', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:10 devstack sudo[93403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-72b88301-7d95-43a7-bfda-dd68d2bacfbf 1073741824 Apr 28 19:26:10 devstack sudo[93403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4621124c-31c8-4953-b3e1-77004231fd71 tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ac9e151-143e-45a1-950b-ade0223fe571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:10 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-4621124c-31c8-4953-b3e1-77004231fd71 tempest-CreateVolumesFromImageTest-1883144102 None] Volume volume-7b98d68f-84cc-41a7-b07f-5bcc23103499 (7b98d68f-84cc-41a7-b07f-5bcc23103499): created successfully Apr 28 19:26:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4621124c-31c8-4953-b3e1-77004231fd71 tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ac9e151-143e-45a1-950b-ade0223fe571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4621124c-31c8-4953-b3e1-77004231fd71 tempest-CreateVolumesFromImageTest-1883144102 None] Flow 'volume_create_manager' (84343043-f161-45d6-ba5b-29731d8c732e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:26:10 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-4621124c-31c8-4953-b3e1-77004231fd71 tempest-CreateVolumesFromImageTest-1883144102 None] Created volume successfully. Apr 28 19:26:11 devstack sudo[93403]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-daa9dc4d-a72f-4b6a-a969-c0ed6d19d10d tempest-CreateVolumesFromImageTest-1883144102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-72b88301-7d95-43a7-bfda-dd68d2bacfbf 1073741824" returned: 0 in 0.969s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-daa9dc4d-a72f-4b6a-a969-c0ed6d19d10d tempest-CreateVolumesFromImageTest-1883144102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-72b88301-7d95-43a7-bfda-dd68d2bacfbf {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:11 devstack sudo[93410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-72b88301-7d95-43a7-bfda-dd68d2bacfbf Apr 28 19:26:11 devstack sudo[93410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:12 devstack sudo[93410]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-daa9dc4d-a72f-4b6a-a969-c0ed6d19d10d tempest-CreateVolumesFromImageTest-1883144102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-72b88301-7d95-43a7-bfda-dd68d2bacfbf" returned: 0 in 0.717s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:12 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-daa9dc4d-a72f-4b6a-a969-c0ed6d19d10d tempest-CreateVolumesFromImageTest-1883144102 None] <== create_volume: return (1724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:26:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-daa9dc4d-a72f-4b6a-a969-c0ed6d19d10d tempest-CreateVolumesFromImageTest-1883144102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.729s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-025229b2-0a02-4264-8cba-4969d4a75301 tempest-CreateVolumesFromImageTest-1883144102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.807s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:12 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-025229b2-0a02-4264-8cba-4969d4a75301 tempest-CreateVolumesFromImageTest-1883144102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1433184745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b348510a-c2a5-46aa-8a56-939c6f803727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='280cf4e5bbb143d6839481ad0b569d07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:26:04Z,use_quota=True,user_id='67aaab913da8415598479a5c3d281591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:26:12 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-025229b2-0a02-4264-8cba-4969d4a75301 tempest-CreateVolumesFromImageTest-1883144102 None] Creating volume b348510a-c2a5-46aa-8a56-939c6f803727 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:26:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-025229b2-0a02-4264-8cba-4969d4a75301 tempest-CreateVolumesFromImageTest-1883144102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-025229b2-0a02-4264-8cba-4969d4a75301 tempest-CreateVolumesFromImageTest-1883144102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:12 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-025229b2-0a02-4264-8cba-4969d4a75301 tempest-CreateVolumesFromImageTest-1883144102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:26:12 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-025229b2-0a02-4264-8cba-4969d4a75301 tempest-CreateVolumesFromImageTest-1883144102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:26:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-025229b2-0a02-4264-8cba-4969d4a75301 tempest-CreateVolumesFromImageTest-1883144102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:12 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-025229b2-0a02-4264-8cba-4969d4a75301 tempest-CreateVolumesFromImageTest-1883144102 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:26:12 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-025229b2-0a02-4264-8cba-4969d4a75301 tempest-CreateVolumesFromImageTest-1883144102 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:26:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-025229b2-0a02-4264-8cba-4969d4a75301 tempest-CreateVolumesFromImageTest-1883144102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b348510a-c2a5-46aa-8a56-939c6f803727 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:12 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-daa9dc4d-a72f-4b6a-a969-c0ed6d19d10d tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3526f7a9-7816-430e-940e-558412f691c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72b88301-7d95-43a7-bfda-dd68d2bacfbf', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:12 devstack sudo[93413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b348510a-c2a5-46aa-8a56-939c6f803727 1073741824 Apr 28 19:26:12 devstack sudo[93413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:12 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-daa9dc4d-a72f-4b6a-a969-c0ed6d19d10d tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2bacbc6-a604-46bb-8764-8768e7caae87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:12 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-daa9dc4d-a72f-4b6a-a969-c0ed6d19d10d tempest-CreateVolumesFromImageTest-1883144102 None] Volume volume-72b88301-7d95-43a7-bfda-dd68d2bacfbf (72b88301-7d95-43a7-bfda-dd68d2bacfbf): created successfully Apr 28 19:26:12 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-daa9dc4d-a72f-4b6a-a969-c0ed6d19d10d tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2bacbc6-a604-46bb-8764-8768e7caae87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:12 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-daa9dc4d-a72f-4b6a-a969-c0ed6d19d10d tempest-CreateVolumesFromImageTest-1883144102 None] Flow 'volume_create_manager' (e8b0c127-e83d-4c1c-a90f-e29ff9378647) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:26:12 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-daa9dc4d-a72f-4b6a-a969-c0ed6d19d10d tempest-CreateVolumesFromImageTest-1883144102 None] Created volume successfully. Apr 28 19:26:13 devstack sudo[93413]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-025229b2-0a02-4264-8cba-4969d4a75301 tempest-CreateVolumesFromImageTest-1883144102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b348510a-c2a5-46aa-8a56-939c6f803727 1073741824" returned: 0 in 0.870s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-025229b2-0a02-4264-8cba-4969d4a75301 tempest-CreateVolumesFromImageTest-1883144102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b348510a-c2a5-46aa-8a56-939c6f803727 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:13 devstack sudo[93419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b348510a-c2a5-46aa-8a56-939c6f803727 Apr 28 19:26:13 devstack sudo[93419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:13 devstack sudo[93419]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-025229b2-0a02-4264-8cba-4969d4a75301 tempest-CreateVolumesFromImageTest-1883144102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b348510a-c2a5-46aa-8a56-939c6f803727" returned: 0 in 0.654s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-025229b2-0a02-4264-8cba-4969d4a75301 tempest-CreateVolumesFromImageTest-1883144102 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:26:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-025229b2-0a02-4264-8cba-4969d4a75301 tempest-CreateVolumesFromImageTest-1883144102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a754a3a4-c49e-4e0e-8a68-2fa9f7c761b2 tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.290s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-025229b2-0a02-4264-8cba-4969d4a75301 tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d932153-3a21-4f93-8d5c-2e7dec1e80e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b348510a-c2a5-46aa-8a56-939c6f803727', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-025229b2-0a02-4264-8cba-4969d4a75301 tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53154086-19b2-4cda-805d-7fc389bb4a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-a754a3a4-c49e-4e0e-8a68-2fa9f7c761b2 tempest-CreateVolumesFromSnapshotTest-899706040 None] Creating offline snapshot 4f2934be-12e7-460b-afe3-dd9707109123 of volume 55e921c8-a5a8-4714-ba18-2d0439daf197 {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 19:26:13 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-025229b2-0a02-4264-8cba-4969d4a75301 tempest-CreateVolumesFromImageTest-1883144102 None] Volume volume-b348510a-c2a5-46aa-8a56-939c6f803727 (b348510a-c2a5-46aa-8a56-939c6f803727): created successfully Apr 28 19:26:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-025229b2-0a02-4264-8cba-4969d4a75301 tempest-CreateVolumesFromImageTest-1883144102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53154086-19b2-4cda-805d-7fc389bb4a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-025229b2-0a02-4264-8cba-4969d4a75301 tempest-CreateVolumesFromImageTest-1883144102 None] Flow 'volume_create_manager' (fc40f120-4c37-4fd5-b897-426e1524e62d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:26:13 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[278da527-0455-4017-ba45-49b3398cdbfb]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:26:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a754a3a4-c49e-4e0e-8a68-2fa9f7c761b2 tempest-CreateVolumesFromSnapshotTest-899706040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55e921c8-a5a8-4714-ba18-2d0439daf197 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:14 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-025229b2-0a02-4264-8cba-4969d4a75301 tempest-CreateVolumesFromImageTest-1883144102 None] Created volume successfully. Apr 28 19:26:14 devstack sudo[93422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55e921c8-a5a8-4714-ba18-2d0439daf197 Apr 28 19:26:14 devstack sudo[93422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:14 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4876089e-3a33-4455-9c19-d6eefadf3bec tempest-CreateVolumesFromImageTest-1883144102 None] Acquiring lock "cinder-b348510a-c2a5-46aa-8a56-939c6f803727-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:26:14 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4876089e-3a33-4455-9c19-d6eefadf3bec tempest-CreateVolumesFromImageTest-1883144102 None] Lock "cinder-b348510a-c2a5-46aa-8a56-939c6f803727-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:26:14 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4876089e-3a33-4455-9c19-d6eefadf3bec tempest-CreateVolumesFromImageTest-1883144102 None] Acquiring lock "cinder-quobyte-b348510a-c2a5-46aa-8a56-939c6f803727" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:26:14 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4876089e-3a33-4455-9c19-d6eefadf3bec tempest-CreateVolumesFromImageTest-1883144102 None] Lock "cinder-quobyte-b348510a-c2a5-46aa-8a56-939c6f803727" acquired by "delete_volume" :: waited 0.014s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:26:14 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9c4cb4-02ae-4c8e-9662-48622eb6687f]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:26:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4876089e-3a33-4455-9c19-d6eefadf3bec tempest-CreateVolumesFromImageTest-1883144102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b348510a-c2a5-46aa-8a56-939c6f803727 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:14 devstack sudo[93426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b348510a-c2a5-46aa-8a56-939c6f803727 Apr 28 19:26:14 devstack sudo[93426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:14 devstack sudo[93422]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a754a3a4-c49e-4e0e-8a68-2fa9f7c761b2 tempest-CreateVolumesFromSnapshotTest-899706040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55e921c8-a5a8-4714-ba18-2d0439daf197" returned: 0 in 0.789s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a754a3a4-c49e-4e0e-8a68-2fa9f7c761b2 tempest-CreateVolumesFromSnapshotTest-899706040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55e921c8-a5a8-4714-ba18-2d0439daf197,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55e921c8-a5a8-4714-ba18-2d0439daf197.4f2934be-12e7-460b-afe3-dd9707109123 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:14 devstack sudo[93429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55e921c8-a5a8-4714-ba18-2d0439daf197,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55e921c8-a5a8-4714-ba18-2d0439daf197.4f2934be-12e7-460b-afe3-dd9707109123 1G Apr 28 19:26:14 devstack sudo[93429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:15 devstack sudo[93426]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4876089e-3a33-4455-9c19-d6eefadf3bec tempest-CreateVolumesFromImageTest-1883144102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b348510a-c2a5-46aa-8a56-939c6f803727" returned: 0 in 0.770s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4876089e-3a33-4455-9c19-d6eefadf3bec tempest-CreateVolumesFromImageTest-1883144102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b348510a-c2a5-46aa-8a56-939c6f803727 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:15 devstack sudo[93437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b348510a-c2a5-46aa-8a56-939c6f803727 Apr 28 19:26:15 devstack sudo[93437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:15 devstack sudo[93429]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a754a3a4-c49e-4e0e-8a68-2fa9f7c761b2 tempest-CreateVolumesFromSnapshotTest-899706040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55e921c8-a5a8-4714-ba18-2d0439daf197,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55e921c8-a5a8-4714-ba18-2d0439daf197.4f2934be-12e7-460b-afe3-dd9707109123 1G" returned: 0 in 0.864s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a754a3a4-c49e-4e0e-8a68-2fa9f7c761b2 tempest-CreateVolumesFromSnapshotTest-899706040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55e921c8-a5a8-4714-ba18-2d0439daf197 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55e921c8-a5a8-4714-ba18-2d0439daf197.4f2934be-12e7-460b-afe3-dd9707109123 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:15 devstack sudo[93439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55e921c8-a5a8-4714-ba18-2d0439daf197 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55e921c8-a5a8-4714-ba18-2d0439daf197.4f2934be-12e7-460b-afe3-dd9707109123 Apr 28 19:26:15 devstack sudo[93439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:16 devstack sudo[93437]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4876089e-3a33-4455-9c19-d6eefadf3bec tempest-CreateVolumesFromImageTest-1883144102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-b348510a-c2a5-46aa-8a56-939c6f803727" returned: 0 in 0.644s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:16 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4876089e-3a33-4455-9c19-d6eefadf3bec tempest-CreateVolumesFromImageTest-1883144102 None] Lock "cinder-quobyte-b348510a-c2a5-46aa-8a56-939c6f803727" released by "delete_volume" :: held 1.476s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:26:16 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-4876089e-3a33-4455-9c19-d6eefadf3bec tempest-CreateVolumesFromImageTest-1883144102 None] Created reservations ['85061f47-cd79-4cba-b504-ef99e209311d', '226d3fe0-67fd-4897-befc-766ba901c011', 'eb1c8f11-d4be-444f-a3a4-01e649645db9', 'b6e66abb-1619-4c04-b646-09c48d18c8cb'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:26:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4876089e-3a33-4455-9c19-d6eefadf3bec tempest-CreateVolumesFromImageTest-1883144102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4876089e-3a33-4455-9c19-d6eefadf3bec tempest-CreateVolumesFromImageTest-1883144102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:16 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4876089e-3a33-4455-9c19-d6eefadf3bec tempest-CreateVolumesFromImageTest-1883144102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:26:16 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4876089e-3a33-4455-9c19-d6eefadf3bec tempest-CreateVolumesFromImageTest-1883144102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:26:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4876089e-3a33-4455-9c19-d6eefadf3bec tempest-CreateVolumesFromImageTest-1883144102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4876089e-3a33-4455-9c19-d6eefadf3bec tempest-CreateVolumesFromImageTest-1883144102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:16 devstack sudo[93443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:26:16 devstack sudo[93443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:16 devstack sudo[93439]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a754a3a4-c49e-4e0e-8a68-2fa9f7c761b2 tempest-CreateVolumesFromSnapshotTest-899706040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55e921c8-a5a8-4714-ba18-2d0439daf197 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55e921c8-a5a8-4714-ba18-2d0439daf197.4f2934be-12e7-460b-afe3-dd9707109123" returned: 0 in 0.826s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:16 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-a754a3a4-c49e-4e0e-8a68-2fa9f7c761b2 tempest-CreateVolumesFromSnapshotTest-899706040 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55e921c8-a5a8-4714-ba18-2d0439daf197.4f2934be-12e7-460b-afe3-dd9707109123 is being set with open permissions: ugo+rw Apr 28 19:26:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a754a3a4-c49e-4e0e-8a68-2fa9f7c761b2 tempest-CreateVolumesFromSnapshotTest-899706040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55e921c8-a5a8-4714-ba18-2d0439daf197.4f2934be-12e7-460b-afe3-dd9707109123 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:16 devstack sudo[93449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55e921c8-a5a8-4714-ba18-2d0439daf197.4f2934be-12e7-460b-afe3-dd9707109123 Apr 28 19:26:16 devstack sudo[93449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:16 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2a74390a-756c-4b18-a554-5d15150baa48 tempest-CreateVolumesFromImageTest-1883144102 None] Acquiring lock "cinder-72b88301-7d95-43a7-bfda-dd68d2bacfbf-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:26:16 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2a74390a-756c-4b18-a554-5d15150baa48 tempest-CreateVolumesFromImageTest-1883144102 None] Lock "cinder-72b88301-7d95-43a7-bfda-dd68d2bacfbf-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:26:16 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2a74390a-756c-4b18-a554-5d15150baa48 tempest-CreateVolumesFromImageTest-1883144102 None] Acquiring lock "cinder-quobyte-72b88301-7d95-43a7-bfda-dd68d2bacfbf" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:26:16 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2a74390a-756c-4b18-a554-5d15150baa48 tempest-CreateVolumesFromImageTest-1883144102 None] Lock "cinder-quobyte-72b88301-7d95-43a7-bfda-dd68d2bacfbf" acquired by "delete_volume" :: waited 0.019s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:26:16 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[254981d1-d1c6-4dfa-abf9-8f13339bb2e8]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:26:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2a74390a-756c-4b18-a554-5d15150baa48 tempest-CreateVolumesFromImageTest-1883144102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-72b88301-7d95-43a7-bfda-dd68d2bacfbf {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:16 devstack sudo[93443]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4876089e-3a33-4455-9c19-d6eefadf3bec tempest-CreateVolumesFromImageTest-1883144102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.693s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:16 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-4876089e-3a33-4455-9c19-d6eefadf3bec tempest-CreateVolumesFromImageTest-1883144102 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:26:16 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-4876089e-3a33-4455-9c19-d6eefadf3bec tempest-CreateVolumesFromImageTest-1883144102 None] Deleted volume successfully. Apr 28 19:26:17 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4876089e-3a33-4455-9c19-d6eefadf3bec tempest-CreateVolumesFromImageTest-1883144102 None] Lock "cinder-b348510a-c2a5-46aa-8a56-939c6f803727-delete_volume" released by "delete_volume" :: held 2.455s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:26:17 devstack sudo[93452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-72b88301-7d95-43a7-bfda-dd68d2bacfbf Apr 28 19:26:17 devstack sudo[93452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:17 devstack sudo[93449]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a754a3a4-c49e-4e0e-8a68-2fa9f7c761b2 tempest-CreateVolumesFromSnapshotTest-899706040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55e921c8-a5a8-4714-ba18-2d0439daf197.4f2934be-12e7-460b-afe3-dd9707109123" returned: 0 in 0.692s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a754a3a4-c49e-4e0e-8a68-2fa9f7c761b2 tempest-CreateVolumesFromSnapshotTest-899706040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55e921c8-a5a8-4714-ba18-2d0439daf197.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:17 devstack sudo[93455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55e921c8-a5a8-4714-ba18-2d0439daf197.info Apr 28 19:26:17 devstack sudo[93455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:17 devstack sudo[93452]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2a74390a-756c-4b18-a554-5d15150baa48 tempest-CreateVolumesFromImageTest-1883144102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-72b88301-7d95-43a7-bfda-dd68d2bacfbf" returned: 0 in 0.897s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2a74390a-756c-4b18-a554-5d15150baa48 tempest-CreateVolumesFromImageTest-1883144102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-72b88301-7d95-43a7-bfda-dd68d2bacfbf {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:17 devstack sudo[93460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-72b88301-7d95-43a7-bfda-dd68d2bacfbf Apr 28 19:26:17 devstack sudo[93460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:18 devstack sudo[93455]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a754a3a4-c49e-4e0e-8a68-2fa9f7c761b2 tempest-CreateVolumesFromSnapshotTest-899706040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55e921c8-a5a8-4714-ba18-2d0439daf197.info" returned: 0 in 0.806s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:18 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-a754a3a4-c49e-4e0e-8a68-2fa9f7c761b2 tempest-CreateVolumesFromSnapshotTest-899706040 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55e921c8-a5a8-4714-ba18-2d0439daf197.info is being set with open permissions: ugo+rw Apr 28 19:26:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a754a3a4-c49e-4e0e-8a68-2fa9f7c761b2 tempest-CreateVolumesFromSnapshotTest-899706040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55e921c8-a5a8-4714-ba18-2d0439daf197.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:18 devstack sudo[93463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55e921c8-a5a8-4714-ba18-2d0439daf197.info Apr 28 19:26:18 devstack sudo[93463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:18 devstack sudo[93460]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2a74390a-756c-4b18-a554-5d15150baa48 tempest-CreateVolumesFromImageTest-1883144102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-72b88301-7d95-43a7-bfda-dd68d2bacfbf" returned: 0 in 0.686s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:18 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2a74390a-756c-4b18-a554-5d15150baa48 tempest-CreateVolumesFromImageTest-1883144102 None] Lock "cinder-quobyte-72b88301-7d95-43a7-bfda-dd68d2bacfbf" released by "delete_volume" :: held 1.644s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:26:18 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-2a74390a-756c-4b18-a554-5d15150baa48 tempest-CreateVolumesFromImageTest-1883144102 None] Created reservations ['3c2f8608-e2a5-4808-82f1-2cb1d7914cf1', '6ef960ff-8a04-4eda-999c-5cfa1713f616', 'b61dacba-c765-4b60-adbd-39bd1965c375', 'd7c696ee-fd30-4409-857a-d6cd6909c436'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:26:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2a74390a-756c-4b18-a554-5d15150baa48 tempest-CreateVolumesFromImageTest-1883144102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2a74390a-756c-4b18-a554-5d15150baa48 tempest-CreateVolumesFromImageTest-1883144102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:18 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2a74390a-756c-4b18-a554-5d15150baa48 tempest-CreateVolumesFromImageTest-1883144102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:26:18 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2a74390a-756c-4b18-a554-5d15150baa48 tempest-CreateVolumesFromImageTest-1883144102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:26:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2a74390a-756c-4b18-a554-5d15150baa48 tempest-CreateVolumesFromImageTest-1883144102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2a74390a-756c-4b18-a554-5d15150baa48 tempest-CreateVolumesFromImageTest-1883144102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:18 devstack sudo[93467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:26:18 devstack sudo[93467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:18 devstack sudo[93463]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a754a3a4-c49e-4e0e-8a68-2fa9f7c761b2 tempest-CreateVolumesFromSnapshotTest-899706040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55e921c8-a5a8-4714-ba18-2d0439daf197.info" returned: 0 in 0.766s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a754a3a4-c49e-4e0e-8a68-2fa9f7c761b2 tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.904s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-84c75b89-40c4-4863-8983-637bdfdcaebe tempest-VolumeDependencyTests-637805770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.011s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:18 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-84c75b89-40c4-4863-8983-637bdfdcaebe tempest-VolumeDependencyTests-637805770 None] Creating offline snapshot 45ed5f04-b689-4b24-8f9c-ec22ee4ac585 of volume e72a8fc1-2ab4-4355-8247-f42ab18d2f45 {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 19:26:18 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc18e869-ed64-49b7-8486-2cba74123b24]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:26:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-84c75b89-40c4-4863-8983-637bdfdcaebe tempest-VolumeDependencyTests-637805770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:18 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-a754a3a4-c49e-4e0e-8a68-2fa9f7c761b2 tempest-CreateVolumesFromSnapshotTest-899706040 None] Create snapshot completed successfully Apr 28 19:26:19 devstack sudo[93469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45 Apr 28 19:26:19 devstack sudo[93469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:19 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5d00e9b9-35eb-49d7-a127-e72209121c4a tempest-CreateVolumesFromImageTest-1883144102 None] Acquiring lock "cinder-7b98d68f-84cc-41a7-b07f-5bcc23103499-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:26:19 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5d00e9b9-35eb-49d7-a127-e72209121c4a tempest-CreateVolumesFromImageTest-1883144102 None] Lock "cinder-7b98d68f-84cc-41a7-b07f-5bcc23103499-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:26:19 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5d00e9b9-35eb-49d7-a127-e72209121c4a tempest-CreateVolumesFromImageTest-1883144102 None] Acquiring lock "cinder-quobyte-7b98d68f-84cc-41a7-b07f-5bcc23103499" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:26:19 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5d00e9b9-35eb-49d7-a127-e72209121c4a tempest-CreateVolumesFromImageTest-1883144102 None] Lock "cinder-quobyte-7b98d68f-84cc-41a7-b07f-5bcc23103499" acquired by "delete_volume" :: waited 0.035s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:26:19 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7b02a4-6b29-4de8-9be1-4438231d7801]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:26:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5d00e9b9-35eb-49d7-a127-e72209121c4a tempest-CreateVolumesFromImageTest-1883144102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7b98d68f-84cc-41a7-b07f-5bcc23103499 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:19 devstack sudo[93471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7b98d68f-84cc-41a7-b07f-5bcc23103499 Apr 28 19:26:19 devstack sudo[93471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:19 devstack sudo[93469]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-84c75b89-40c4-4863-8983-637bdfdcaebe tempest-VolumeDependencyTests-637805770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45" returned: 0 in 1.000s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:19 devstack sudo[93467]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-84c75b89-40c4-4863-8983-637bdfdcaebe tempest-VolumeDependencyTests-637805770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45.45ed5f04-b689-4b24-8f9c-ec22ee4ac585 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2a74390a-756c-4b18-a554-5d15150baa48 tempest-CreateVolumesFromImageTest-1883144102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 1.239s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:19 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-2a74390a-756c-4b18-a554-5d15150baa48 tempest-CreateVolumesFromImageTest-1883144102 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:26:19 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-2a74390a-756c-4b18-a554-5d15150baa48 tempest-CreateVolumesFromImageTest-1883144102 None] Deleted volume successfully. Apr 28 19:26:19 devstack sudo[93478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45.45ed5f04-b689-4b24-8f9c-ec22ee4ac585 1G Apr 28 19:26:19 devstack sudo[93478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:19 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2a74390a-756c-4b18-a554-5d15150baa48 tempest-CreateVolumesFromImageTest-1883144102 None] Lock "cinder-72b88301-7d95-43a7-bfda-dd68d2bacfbf-delete_volume" released by "delete_volume" :: held 3.181s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:26:20 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-513f934d-2e58-4bc5-9ae3-5653a62eea18 tempest-CreateVolumesFromSnapshotTest-899706040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:26:20 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-513f934d-2e58-4bc5-9ae3-5653a62eea18 tempest-CreateVolumesFromSnapshotTest-899706040 None] Flow 'volume_create_manager' (7eb64961-18f7-47f1-8045-6fef9356727a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:26:20 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-513f934d-2e58-4bc5-9ae3-5653a62eea18 tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (997415c8-7205-4f94-a5ea-647dda5c07c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:20 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-513f934d-2e58-4bc5-9ae3-5653a62eea18 tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (997415c8-7205-4f94-a5ea-647dda5c07c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:26:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-259037355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc5357b5-364c-4ce8-9a59-e1f722cef8fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec9c30e85d743d1bebeb058dbf67aff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:26:20Z,use_quota=True,user_id='6368d1e0ff4b4d2e9057b330a940de2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:20 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-513f934d-2e58-4bc5-9ae3-5653a62eea18 tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (043e809c-6c88-40e7-9174-20d7c43ae1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:20 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-513f934d-2e58-4bc5-9ae3-5653a62eea18 tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (043e809c-6c88-40e7-9174-20d7c43ae1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:20 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-513f934d-2e58-4bc5-9ae3-5653a62eea18 tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35c7b9e3-a04f-4af3-8c09-335d6003b7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:20 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-513f934d-2e58-4bc5-9ae3-5653a62eea18 tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35c7b9e3-a04f-4af3-8c09-335d6003b7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc5357b5-364c-4ce8-9a59-e1f722cef8fd', 'volume_name': 'volume-bc5357b5-364c-4ce8-9a59-e1f722cef8fd', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:20 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-513f934d-2e58-4bc5-9ae3-5653a62eea18 tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (639b2f5b-93f5-4b8a-a7ff-4c1ce77278be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:20 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-513f934d-2e58-4bc5-9ae3-5653a62eea18 tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (639b2f5b-93f5-4b8a-a7ff-4c1ce77278be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:20 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-513f934d-2e58-4bc5-9ae3-5653a62eea18 tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e4a058e-f413-499b-9330-da3c15b682d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:20 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-513f934d-2e58-4bc5-9ae3-5653a62eea18 tempest-CreateVolumesFromSnapshotTest-899706040 None] Volume bc5357b5-364c-4ce8-9a59-e1f722cef8fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc5357b5-364c-4ce8-9a59-e1f722cef8fd', 'volume_size': 1} Apr 28 19:26:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-513f934d-2e58-4bc5-9ae3-5653a62eea18 tempest-CreateVolumesFromSnapshotTest-899706040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:20 devstack sudo[93471]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5d00e9b9-35eb-49d7-a127-e72209121c4a tempest-CreateVolumesFromImageTest-1883144102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7b98d68f-84cc-41a7-b07f-5bcc23103499" returned: 0 in 1.313s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5d00e9b9-35eb-49d7-a127-e72209121c4a tempest-CreateVolumesFromImageTest-1883144102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7b98d68f-84cc-41a7-b07f-5bcc23103499 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:20 devstack sudo[93485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7b98d68f-84cc-41a7-b07f-5bcc23103499 Apr 28 19:26:20 devstack sudo[93485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:20 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca42771b-0469-442a-aa10-ec2fc87bf1b0 tempest-CreateVolumesFromSnapshotTest-899706040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:26:20 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ca42771b-0469-442a-aa10-ec2fc87bf1b0 tempest-CreateVolumesFromSnapshotTest-899706040 None] Flow 'volume_create_manager' (6023af90-49fc-4eff-8b9d-f536aef4f55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:26:20 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ca42771b-0469-442a-aa10-ec2fc87bf1b0 tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa5c8ce9-1e7a-484f-9486-9c61ac81b5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ca42771b-0469-442a-aa10-ec2fc87bf1b0 tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa5c8ce9-1e7a-484f-9486-9c61ac81b5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:26:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2059405931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44039bfb-38a1-4a5d-aa1e-85626b22a54e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec9c30e85d743d1bebeb058dbf67aff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:26:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:26:21Z,use_quota=True,user_id='6368d1e0ff4b4d2e9057b330a940de2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ca42771b-0469-442a-aa10-ec2fc87bf1b0 tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb5ad52f-0265-4e35-94b3-12ab0722c329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ca42771b-0469-442a-aa10-ec2fc87bf1b0 tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb5ad52f-0265-4e35-94b3-12ab0722c329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ca42771b-0469-442a-aa10-ec2fc87bf1b0 tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47147b13-8276-4352-ba81-520a74fb0258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ca42771b-0469-442a-aa10-ec2fc87bf1b0 tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47147b13-8276-4352-ba81-520a74fb0258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44039bfb-38a1-4a5d-aa1e-85626b22a54e', 'volume_name': 'volume-44039bfb-38a1-4a5d-aa1e-85626b22a54e', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ca42771b-0469-442a-aa10-ec2fc87bf1b0 tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8623831a-d022-49a0-b3b5-651bda0b2762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ca42771b-0469-442a-aa10-ec2fc87bf1b0 tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8623831a-d022-49a0-b3b5-651bda0b2762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ca42771b-0469-442a-aa10-ec2fc87bf1b0 tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c73b025a-24af-49bb-af93-a323a397b181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:21 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-ca42771b-0469-442a-aa10-ec2fc87bf1b0 tempest-CreateVolumesFromSnapshotTest-899706040 None] Volume 44039bfb-38a1-4a5d-aa1e-85626b22a54e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44039bfb-38a1-4a5d-aa1e-85626b22a54e', 'volume_size': 1} Apr 28 19:26:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ca42771b-0469-442a-aa10-ec2fc87bf1b0 tempest-CreateVolumesFromSnapshotTest-899706040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:21 devstack sudo[93478]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-84c75b89-40c4-4863-8983-637bdfdcaebe tempest-VolumeDependencyTests-637805770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45.45ed5f04-b689-4b24-8f9c-ec22ee4ac585 1G" returned: 0 in 1.198s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-84c75b89-40c4-4863-8983-637bdfdcaebe tempest-VolumeDependencyTests-637805770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45.45ed5f04-b689-4b24-8f9c-ec22ee4ac585 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:21 devstack sudo[93490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45.45ed5f04-b689-4b24-8f9c-ec22ee4ac585 Apr 28 19:26:21 devstack sudo[93490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:21 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea3df258-1e81-423c-aebe-de9a7a09190f tempest-CreateVolumesFromSnapshotTest-899706040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:26:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ea3df258-1e81-423c-aebe-de9a7a09190f tempest-CreateVolumesFromSnapshotTest-899706040 None] Flow 'volume_create_manager' (8ecbc2c7-a74d-4f7b-9e17-e81c425bd696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:26:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ea3df258-1e81-423c-aebe-de9a7a09190f tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f779bc5f-7a75-443e-a4b4-4913fa069380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ea3df258-1e81-423c-aebe-de9a7a09190f tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f779bc5f-7a75-443e-a4b4-4913fa069380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:26:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-770484689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fe74f0a-18c0-4849-a299-c9faf98cf659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec9c30e85d743d1bebeb058dbf67aff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:26:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:26:21Z,use_quota=True,user_id='6368d1e0ff4b4d2e9057b330a940de2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ea3df258-1e81-423c-aebe-de9a7a09190f tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61df0066-ad66-4d27-b5d7-24c2ec2d1b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ea3df258-1e81-423c-aebe-de9a7a09190f tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61df0066-ad66-4d27-b5d7-24c2ec2d1b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ea3df258-1e81-423c-aebe-de9a7a09190f tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16feb780-3ba5-4a35-9e4d-cb2fc2b4ba80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ea3df258-1e81-423c-aebe-de9a7a09190f tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16feb780-3ba5-4a35-9e4d-cb2fc2b4ba80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fe74f0a-18c0-4849-a299-c9faf98cf659', 'volume_name': 'volume-0fe74f0a-18c0-4849-a299-c9faf98cf659', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ea3df258-1e81-423c-aebe-de9a7a09190f tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd66af98-3bf7-4f2b-bcb1-0cb05a5631e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ea3df258-1e81-423c-aebe-de9a7a09190f tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd66af98-3bf7-4f2b-bcb1-0cb05a5631e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ea3df258-1e81-423c-aebe-de9a7a09190f tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db4b7235-682b-4efe-bbb1-808ab007f721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:21 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-ea3df258-1e81-423c-aebe-de9a7a09190f tempest-CreateVolumesFromSnapshotTest-899706040 None] Volume 0fe74f0a-18c0-4849-a299-c9faf98cf659: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fe74f0a-18c0-4849-a299-c9faf98cf659', 'volume_size': 1} Apr 28 19:26:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ea3df258-1e81-423c-aebe-de9a7a09190f tempest-CreateVolumesFromSnapshotTest-899706040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:21 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-448fe4b7-7e8d-4dc5-b0be-3824753e5742 tempest-CreateVolumesFromSnapshotTest-899706040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:26:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-448fe4b7-7e8d-4dc5-b0be-3824753e5742 tempest-CreateVolumesFromSnapshotTest-899706040 None] Flow 'volume_create_manager' (de7cf7d2-3c98-4df0-81da-e7a713cc82a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:26:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-448fe4b7-7e8d-4dc5-b0be-3824753e5742 tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97afea1a-2579-4577-976c-511ada3f5b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:21 devstack sudo[93485]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-448fe4b7-7e8d-4dc5-b0be-3824753e5742 tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97afea1a-2579-4577-976c-511ada3f5b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:26:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-859168570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b36bfc1-679d-430b-9f57-f0c21934ba00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec9c30e85d743d1bebeb058dbf67aff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:26:22Z,use_quota=True,user_id='6368d1e0ff4b4d2e9057b330a940de2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-448fe4b7-7e8d-4dc5-b0be-3824753e5742 tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b27ef2ee-112f-4346-af79-59ca86ce62f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-448fe4b7-7e8d-4dc5-b0be-3824753e5742 tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b27ef2ee-112f-4346-af79-59ca86ce62f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-448fe4b7-7e8d-4dc5-b0be-3824753e5742 tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8464d500-8a02-4716-909c-5e0639d46690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-448fe4b7-7e8d-4dc5-b0be-3824753e5742 tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8464d500-8a02-4716-909c-5e0639d46690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b36bfc1-679d-430b-9f57-f0c21934ba00', 'volume_name': 'volume-5b36bfc1-679d-430b-9f57-f0c21934ba00', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-448fe4b7-7e8d-4dc5-b0be-3824753e5742 tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28ee777b-99e7-4212-ace7-d5ba268e9450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-448fe4b7-7e8d-4dc5-b0be-3824753e5742 tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28ee777b-99e7-4212-ace7-d5ba268e9450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-448fe4b7-7e8d-4dc5-b0be-3824753e5742 tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92eccd48-79c2-4dc4-87de-d650a5a9d896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:21 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-448fe4b7-7e8d-4dc5-b0be-3824753e5742 tempest-CreateVolumesFromSnapshotTest-899706040 None] Volume 5b36bfc1-679d-430b-9f57-f0c21934ba00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b36bfc1-679d-430b-9f57-f0c21934ba00', 'volume_size': 1} Apr 28 19:26:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-448fe4b7-7e8d-4dc5-b0be-3824753e5742 tempest-CreateVolumesFromSnapshotTest-899706040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5d00e9b9-35eb-49d7-a127-e72209121c4a tempest-CreateVolumesFromImageTest-1883144102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-7b98d68f-84cc-41a7-b07f-5bcc23103499" returned: 0 in 1.079s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:21 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5d00e9b9-35eb-49d7-a127-e72209121c4a tempest-CreateVolumesFromImageTest-1883144102 None] Lock "cinder-quobyte-7b98d68f-84cc-41a7-b07f-5bcc23103499" released by "delete_volume" :: held 2.483s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:26:21 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-5d00e9b9-35eb-49d7-a127-e72209121c4a tempest-CreateVolumesFromImageTest-1883144102 None] Created reservations ['957783fa-93f9-4851-83bf-557d15711161', 'd1a877f5-2684-4e1c-abe2-43a767842e0c', 'e0b71f61-3956-48b3-8304-428725ee02ee', '03cde96f-d7b9-46ea-8713-f9d7b773df28'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:26:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5d00e9b9-35eb-49d7-a127-e72209121c4a tempest-CreateVolumesFromImageTest-1883144102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5d00e9b9-35eb-49d7-a127-e72209121c4a tempest-CreateVolumesFromImageTest-1883144102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:22 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5d00e9b9-35eb-49d7-a127-e72209121c4a tempest-CreateVolumesFromImageTest-1883144102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:26:22 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5d00e9b9-35eb-49d7-a127-e72209121c4a tempest-CreateVolumesFromImageTest-1883144102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:26:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5d00e9b9-35eb-49d7-a127-e72209121c4a tempest-CreateVolumesFromImageTest-1883144102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5d00e9b9-35eb-49d7-a127-e72209121c4a tempest-CreateVolumesFromImageTest-1883144102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:22 devstack sudo[93496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:26:22 devstack sudo[93496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:22 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d4a60c9-dcf1-4f1a-b2d4-aa33beec2cbe tempest-CreateVolumesFromSnapshotTest-899706040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:26:22 devstack sudo[93490]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:22 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0d4a60c9-dcf1-4f1a-b2d4-aa33beec2cbe tempest-CreateVolumesFromSnapshotTest-899706040 None] Flow 'volume_create_manager' (c70dc8d0-f9fa-49fb-954b-3e2f73979134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:26:22 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0d4a60c9-dcf1-4f1a-b2d4-aa33beec2cbe tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (597b7ae1-b499-4f81-8301-08b4cd1e2155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-84c75b89-40c4-4863-8983-637bdfdcaebe tempest-VolumeDependencyTests-637805770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45.45ed5f04-b689-4b24-8f9c-ec22ee4ac585" returned: 0 in 1.173s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:22 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-84c75b89-40c4-4863-8983-637bdfdcaebe tempest-VolumeDependencyTests-637805770 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45.45ed5f04-b689-4b24-8f9c-ec22ee4ac585 is being set with open permissions: ugo+rw Apr 28 19:26:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-84c75b89-40c4-4863-8983-637bdfdcaebe tempest-VolumeDependencyTests-637805770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45.45ed5f04-b689-4b24-8f9c-ec22ee4ac585 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:22 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0d4a60c9-dcf1-4f1a-b2d4-aa33beec2cbe tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (597b7ae1-b499-4f81-8301-08b4cd1e2155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1657763273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74c4569b-39ad-4662-b92e-80f43cfeee06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec9c30e85d743d1bebeb058dbf67aff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:26:22Z,use_quota=True,user_id='6368d1e0ff4b4d2e9057b330a940de2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:22 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0d4a60c9-dcf1-4f1a-b2d4-aa33beec2cbe tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b9f9147-a347-4f68-9995-7cd7bbb0f869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:22 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0d4a60c9-dcf1-4f1a-b2d4-aa33beec2cbe tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b9f9147-a347-4f68-9995-7cd7bbb0f869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:22 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0d4a60c9-dcf1-4f1a-b2d4-aa33beec2cbe tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cf34ac3-ce7f-427a-bbd3-d29d6ce2ccb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:22 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0d4a60c9-dcf1-4f1a-b2d4-aa33beec2cbe tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cf34ac3-ce7f-427a-bbd3-d29d6ce2ccb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74c4569b-39ad-4662-b92e-80f43cfeee06', 'volume_name': 'volume-74c4569b-39ad-4662-b92e-80f43cfeee06', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:22 devstack sudo[93498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45.45ed5f04-b689-4b24-8f9c-ec22ee4ac585 Apr 28 19:26:22 devstack sudo[93498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:22 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0d4a60c9-dcf1-4f1a-b2d4-aa33beec2cbe tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ad0f2f0-89cd-421b-a8a8-590f20f5e4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:22 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0d4a60c9-dcf1-4f1a-b2d4-aa33beec2cbe tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ad0f2f0-89cd-421b-a8a8-590f20f5e4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:22 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0d4a60c9-dcf1-4f1a-b2d4-aa33beec2cbe tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3588508-073c-4042-8c29-92ff7f24e57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:22 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-0d4a60c9-dcf1-4f1a-b2d4-aa33beec2cbe tempest-CreateVolumesFromSnapshotTest-899706040 None] Volume 74c4569b-39ad-4662-b92e-80f43cfeee06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74c4569b-39ad-4662-b92e-80f43cfeee06', 'volume_size': 1} Apr 28 19:26:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0d4a60c9-dcf1-4f1a-b2d4-aa33beec2cbe tempest-CreateVolumesFromSnapshotTest-899706040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:22 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8a8dcb8f-e98b-47a1-ad84-1cb713795b15 tempest-CreateVolumesFromImageTest-1883144102 None] Acquiring lock "cinder-ff40ab43-7121-439b-88e0-03b6d51b3cf9-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:26:22 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8a8dcb8f-e98b-47a1-ad84-1cb713795b15 tempest-CreateVolumesFromImageTest-1883144102 None] Lock "cinder-ff40ab43-7121-439b-88e0-03b6d51b3cf9-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:26:22 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8a8dcb8f-e98b-47a1-ad84-1cb713795b15 tempest-CreateVolumesFromImageTest-1883144102 None] Acquiring lock "cinder-quobyte-ff40ab43-7121-439b-88e0-03b6d51b3cf9" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:26:22 devstack sudo[93496]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5d00e9b9-35eb-49d7-a127-e72209121c4a tempest-CreateVolumesFromImageTest-1883144102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.914s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:22 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-5d00e9b9-35eb-49d7-a127-e72209121c4a tempest-CreateVolumesFromImageTest-1883144102 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:26:22 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8a8dcb8f-e98b-47a1-ad84-1cb713795b15 tempest-CreateVolumesFromImageTest-1883144102 None] Lock "cinder-quobyte-ff40ab43-7121-439b-88e0-03b6d51b3cf9" acquired by "delete_volume" :: waited 0.026s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:26:23 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-5d00e9b9-35eb-49d7-a127-e72209121c4a tempest-CreateVolumesFromImageTest-1883144102 None] Deleted volume successfully. Apr 28 19:26:23 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[021ac27e-363e-41c4-95ba-f2bfb8c4b521]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:26:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8a8dcb8f-e98b-47a1-ad84-1cb713795b15 tempest-CreateVolumesFromImageTest-1883144102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ff40ab43-7121-439b-88e0-03b6d51b3cf9 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:23 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5d00e9b9-35eb-49d7-a127-e72209121c4a tempest-CreateVolumesFromImageTest-1883144102 None] Lock "cinder-7b98d68f-84cc-41a7-b07f-5bcc23103499-delete_volume" released by "delete_volume" :: held 3.825s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:26:23 devstack sudo[93501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ff40ab43-7121-439b-88e0-03b6d51b3cf9 Apr 28 19:26:23 devstack sudo[93501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:23 devstack sudo[93498]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-84c75b89-40c4-4863-8983-637bdfdcaebe tempest-VolumeDependencyTests-637805770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45.45ed5f04-b689-4b24-8f9c-ec22ee4ac585" returned: 0 in 0.873s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-84c75b89-40c4-4863-8983-637bdfdcaebe tempest-VolumeDependencyTests-637805770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:23 devstack sudo[93504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45.info Apr 28 19:26:23 devstack sudo[93504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:23 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-a78696f3-e098-4555-a818-6ce47f760392 tempest-SnapshotDependencyTests-840224214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:26:23 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a78696f3-e098-4555-a818-6ce47f760392 tempest-SnapshotDependencyTests-840224214 None] Flow 'volume_create_manager' (006f34bb-1df4-4ae8-b208-fdd86181d32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:26:23 devstack sudo[93501]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:23 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a78696f3-e098-4555-a818-6ce47f760392 tempest-SnapshotDependencyTests-840224214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4fb12b5-b823-4844-990e-f8e58abfd645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8a8dcb8f-e98b-47a1-ad84-1cb713795b15 tempest-CreateVolumesFromImageTest-1883144102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ff40ab43-7121-439b-88e0-03b6d51b3cf9" returned: 0 in 0.845s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8a8dcb8f-e98b-47a1-ad84-1cb713795b15 tempest-CreateVolumesFromImageTest-1883144102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ff40ab43-7121-439b-88e0-03b6d51b3cf9 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:23 devstack sudo[93504]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-84c75b89-40c4-4863-8983-637bdfdcaebe tempest-VolumeDependencyTests-637805770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45.info" returned: 0 in 0.680s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:23 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-84c75b89-40c4-4863-8983-637bdfdcaebe tempest-VolumeDependencyTests-637805770 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45.info is being set with open permissions: ugo+rw Apr 28 19:26:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-84c75b89-40c4-4863-8983-637bdfdcaebe tempest-VolumeDependencyTests-637805770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:23 devstack sudo[93510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ff40ab43-7121-439b-88e0-03b6d51b3cf9 Apr 28 19:26:23 devstack sudo[93510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:23 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a78696f3-e098-4555-a818-6ce47f760392 tempest-SnapshotDependencyTests-840224214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4fb12b5-b823-4844-990e-f8e58abfd645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1122356546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10db6bdd-2497-44a9-8434-15c06d8d00eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94aade7cbe8549f2a36923e04b232ad0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:26:24Z,use_quota=True,user_id='3246233ee2dd480b8a54a4267f9c4538',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:23 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a78696f3-e098-4555-a818-6ce47f760392 tempest-SnapshotDependencyTests-840224214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81b10f00-da52-40de-a199-f920e0c9e9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:23 devstack sudo[93512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45.info Apr 28 19:26:23 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a78696f3-e098-4555-a818-6ce47f760392 tempest-SnapshotDependencyTests-840224214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81b10f00-da52-40de-a199-f920e0c9e9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:23 devstack sudo[93512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:23 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a78696f3-e098-4555-a818-6ce47f760392 tempest-SnapshotDependencyTests-840224214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2811b32a-d237-418d-941e-fa75654adee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:23 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a78696f3-e098-4555-a818-6ce47f760392 tempest-SnapshotDependencyTests-840224214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2811b32a-d237-418d-941e-fa75654adee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10db6bdd-2497-44a9-8434-15c06d8d00eb', 'volume_name': 'volume-10db6bdd-2497-44a9-8434-15c06d8d00eb', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:23 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a78696f3-e098-4555-a818-6ce47f760392 tempest-SnapshotDependencyTests-840224214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f4afe00-2041-4504-bcaf-e2d38bb6e35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:23 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a78696f3-e098-4555-a818-6ce47f760392 tempest-SnapshotDependencyTests-840224214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f4afe00-2041-4504-bcaf-e2d38bb6e35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:23 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a78696f3-e098-4555-a818-6ce47f760392 tempest-SnapshotDependencyTests-840224214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a1f80bf-1750-40fa-b19a-76d45cf1bea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:23 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-a78696f3-e098-4555-a818-6ce47f760392 tempest-SnapshotDependencyTests-840224214 None] Volume 10db6bdd-2497-44a9-8434-15c06d8d00eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10db6bdd-2497-44a9-8434-15c06d8d00eb', 'volume_size': 1} Apr 28 19:26:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a78696f3-e098-4555-a818-6ce47f760392 tempest-SnapshotDependencyTests-840224214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:24 devstack sudo[93510]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8a8dcb8f-e98b-47a1-ad84-1cb713795b15 tempest-CreateVolumesFromImageTest-1883144102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-ff40ab43-7121-439b-88e0-03b6d51b3cf9" returned: 0 in 0.638s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:24 devstack sudo[93512]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-84c75b89-40c4-4863-8983-637bdfdcaebe tempest-VolumeDependencyTests-637805770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45.info" returned: 0 in 0.630s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-84c75b89-40c4-4863-8983-637bdfdcaebe tempest-VolumeDependencyTests-637805770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.697s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:24 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8a8dcb8f-e98b-47a1-ad84-1cb713795b15 tempest-CreateVolumesFromImageTest-1883144102 None] Lock "cinder-quobyte-ff40ab43-7121-439b-88e0-03b6d51b3cf9" released by "delete_volume" :: held 1.550s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:26:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-513f934d-2e58-4bc5-9ae3-5653a62eea18 tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.113s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:24 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-513f934d-2e58-4bc5-9ae3-5653a62eea18 tempest-CreateVolumesFromSnapshotTest-899706040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:26:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-259037355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc5357b5-364c-4ce8-9a59-e1f722cef8fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec9c30e85d743d1bebeb058dbf67aff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:26:20Z,use_quota=True,user_id='6368d1e0ff4b4d2e9057b330a940de2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:26:24 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-513f934d-2e58-4bc5-9ae3-5653a62eea18 tempest-CreateVolumesFromSnapshotTest-899706040 None] Creating volume bc5357b5-364c-4ce8-9a59-e1f722cef8fd {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:26:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-513f934d-2e58-4bc5-9ae3-5653a62eea18 tempest-CreateVolumesFromSnapshotTest-899706040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-513f934d-2e58-4bc5-9ae3-5653a62eea18 tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:24 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-513f934d-2e58-4bc5-9ae3-5653a62eea18 tempest-CreateVolumesFromSnapshotTest-899706040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:26:24 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-513f934d-2e58-4bc5-9ae3-5653a62eea18 tempest-CreateVolumesFromSnapshotTest-899706040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:26:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-513f934d-2e58-4bc5-9ae3-5653a62eea18 tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:24 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-513f934d-2e58-4bc5-9ae3-5653a62eea18 tempest-CreateVolumesFromSnapshotTest-899706040 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:26:24 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-513f934d-2e58-4bc5-9ae3-5653a62eea18 tempest-CreateVolumesFromSnapshotTest-899706040 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:26:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-513f934d-2e58-4bc5-9ae3-5653a62eea18 tempest-CreateVolumesFromSnapshotTest-899706040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bc5357b5-364c-4ce8-9a59-e1f722cef8fd 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:24 devstack sudo[93516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bc5357b5-364c-4ce8-9a59-e1f722cef8fd 1073741824 Apr 28 19:26:24 devstack sudo[93516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:24 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-84c75b89-40c4-4863-8983-637bdfdcaebe tempest-VolumeDependencyTests-637805770 None] Create snapshot completed successfully Apr 28 19:26:24 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-8a8dcb8f-e98b-47a1-ad84-1cb713795b15 tempest-CreateVolumesFromImageTest-1883144102 None] Created reservations ['9157fa35-0faf-46b5-87b7-0a544c47ae52', 'f25887d3-5dfe-4d55-91fc-5f30b4185632', 'd5a83351-ca2d-4c40-9809-57b478a150ce', 'adc9177b-28f8-47e5-94a9-e4b0aa6bd072'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:26:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8a8dcb8f-e98b-47a1-ad84-1cb713795b15 tempest-CreateVolumesFromImageTest-1883144102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8a8dcb8f-e98b-47a1-ad84-1cb713795b15 tempest-CreateVolumesFromImageTest-1883144102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:24 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-8a8dcb8f-e98b-47a1-ad84-1cb713795b15 tempest-CreateVolumesFromImageTest-1883144102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:26:24 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-8a8dcb8f-e98b-47a1-ad84-1cb713795b15 tempest-CreateVolumesFromImageTest-1883144102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:26:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8a8dcb8f-e98b-47a1-ad84-1cb713795b15 tempest-CreateVolumesFromImageTest-1883144102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8a8dcb8f-e98b-47a1-ad84-1cb713795b15 tempest-CreateVolumesFromImageTest-1883144102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:24 devstack sudo[93518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:26:24 devstack sudo[93518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:25 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-32fdafdc-5dea-4b87-8175-fe7ab2512a6e tempest-CreateVolumesFromImageTest-1883144102 None] Acquiring lock "cinder-fe1316e8-1a63-4d95-8120-70cd4d93df8c-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:26:25 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-32fdafdc-5dea-4b87-8175-fe7ab2512a6e tempest-CreateVolumesFromImageTest-1883144102 None] Lock "cinder-fe1316e8-1a63-4d95-8120-70cd4d93df8c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:26:25 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-32fdafdc-5dea-4b87-8175-fe7ab2512a6e tempest-CreateVolumesFromImageTest-1883144102 None] Acquiring lock "cinder-quobyte-fe1316e8-1a63-4d95-8120-70cd4d93df8c" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:26:25 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-32fdafdc-5dea-4b87-8175-fe7ab2512a6e tempest-CreateVolumesFromImageTest-1883144102 None] Lock "cinder-quobyte-fe1316e8-1a63-4d95-8120-70cd4d93df8c" acquired by "delete_volume" :: waited 0.019s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:26:25 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ebc18c-8fa8-471a-914b-4486e83a21d3]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:26:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-32fdafdc-5dea-4b87-8175-fe7ab2512a6e tempest-CreateVolumesFromImageTest-1883144102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fe1316e8-1a63-4d95-8120-70cd4d93df8c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:25 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:26:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] Flow 'volume_create_manager' (c0dbced1-6ab2-431a-9979-5cfdbe0b5a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:26:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6c54b64-44a2-4e45-8584-971bb4a3498f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:25 devstack sudo[93523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fe1316e8-1a63-4d95-8120-70cd4d93df8c Apr 28 19:26:25 devstack sudo[93523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6c54b64-44a2-4e45-8584-971bb4a3498f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2061930828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fb322f0-db37-4367-a796-8a5ca80515c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dec47550fdfb4870b6e7667d4a4ef673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=45ed5f04-b689-4b24-8f9c-ec22ee4ac585,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:26:25Z,use_quota=True,user_id='4b5be3fcfe14488181e5b7b0cbbb1bde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b029dfcc-2792-467d-8e33-72ec71616721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b029dfcc-2792-467d-8e33-72ec71616721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:25 devstack sudo[93518]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (174edace-3c0f-4624-a3f1-9b9c3d6661c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (174edace-3c0f-4624-a3f1-9b9c3d6661c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9fb322f0-db37-4367-a796-8a5ca80515c4', 'volume_name': 'volume-9fb322f0-db37-4367-a796-8a5ca80515c4', 'volume_size': 1, 'snapshot_id': '45ed5f04-b689-4b24-8f9c-ec22ee4ac585'}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18e82080-d8b5-4344-83d9-947beb894904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18e82080-d8b5-4344-83d9-947beb894904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9768df7a-250b-40f8-baa5-f1b12d372717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:25 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] Volume 9fb322f0-db37-4367-a796-8a5ca80515c4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9fb322f0-db37-4367-a796-8a5ca80515c4', 'volume_size': 1, 'snapshot_id': '45ed5f04-b689-4b24-8f9c-ec22ee4ac585'} Apr 28 19:26:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8a8dcb8f-e98b-47a1-ad84-1cb713795b15 tempest-CreateVolumesFromImageTest-1883144102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.825s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:25 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-8a8dcb8f-e98b-47a1-ad84-1cb713795b15 tempest-CreateVolumesFromImageTest-1883144102 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:26:25 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-8a8dcb8f-e98b-47a1-ad84-1cb713795b15 tempest-CreateVolumesFromImageTest-1883144102 None] Deleted volume successfully. Apr 28 19:26:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:25 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8a8dcb8f-e98b-47a1-ad84-1cb713795b15 tempest-CreateVolumesFromImageTest-1883144102 None] Lock "cinder-ff40ab43-7121-439b-88e0-03b6d51b3cf9-delete_volume" released by "delete_volume" :: held 2.653s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:26:25 devstack sudo[93516]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-513f934d-2e58-4bc5-9ae3-5653a62eea18 tempest-CreateVolumesFromSnapshotTest-899706040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bc5357b5-364c-4ce8-9a59-e1f722cef8fd 1073741824" returned: 0 in 1.000s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-513f934d-2e58-4bc5-9ae3-5653a62eea18 tempest-CreateVolumesFromSnapshotTest-899706040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bc5357b5-364c-4ce8-9a59-e1f722cef8fd {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:25 devstack sudo[93527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bc5357b5-364c-4ce8-9a59-e1f722cef8fd Apr 28 19:26:25 devstack sudo[93527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:26 devstack sudo[93523]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-32fdafdc-5dea-4b87-8175-fe7ab2512a6e tempest-CreateVolumesFromImageTest-1883144102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fe1316e8-1a63-4d95-8120-70cd4d93df8c" returned: 0 in 0.737s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-32fdafdc-5dea-4b87-8175-fe7ab2512a6e tempest-CreateVolumesFromImageTest-1883144102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fe1316e8-1a63-4d95-8120-70cd4d93df8c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:26 devstack sudo[93532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fe1316e8-1a63-4d95-8120-70cd4d93df8c Apr 28 19:26:26 devstack sudo[93532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:26 devstack sudo[93527]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-513f934d-2e58-4bc5-9ae3-5653a62eea18 tempest-CreateVolumesFromSnapshotTest-899706040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bc5357b5-364c-4ce8-9a59-e1f722cef8fd" returned: 0 in 0.651s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:26 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-513f934d-2e58-4bc5-9ae3-5653a62eea18 tempest-CreateVolumesFromSnapshotTest-899706040 None] <== create_volume: return (1686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:26:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-513f934d-2e58-4bc5-9ae3-5653a62eea18 tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.688s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ca42771b-0469-442a-aa10-ec2fc87bf1b0 tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.142s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:26 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ca42771b-0469-442a-aa10-ec2fc87bf1b0 tempest-CreateVolumesFromSnapshotTest-899706040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:26:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2059405931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44039bfb-38a1-4a5d-aa1e-85626b22a54e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec9c30e85d743d1bebeb058dbf67aff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:26:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:26:21Z,use_quota=True,user_id='6368d1e0ff4b4d2e9057b330a940de2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:26:26 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-ca42771b-0469-442a-aa10-ec2fc87bf1b0 tempest-CreateVolumesFromSnapshotTest-899706040 None] Creating volume 44039bfb-38a1-4a5d-aa1e-85626b22a54e {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:26:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ca42771b-0469-442a-aa10-ec2fc87bf1b0 tempest-CreateVolumesFromSnapshotTest-899706040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ca42771b-0469-442a-aa10-ec2fc87bf1b0 tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:26 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ca42771b-0469-442a-aa10-ec2fc87bf1b0 tempest-CreateVolumesFromSnapshotTest-899706040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:26:26 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ca42771b-0469-442a-aa10-ec2fc87bf1b0 tempest-CreateVolumesFromSnapshotTest-899706040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:26:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ca42771b-0469-442a-aa10-ec2fc87bf1b0 tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:26 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ca42771b-0469-442a-aa10-ec2fc87bf1b0 tempest-CreateVolumesFromSnapshotTest-899706040 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:26:26 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-ca42771b-0469-442a-aa10-ec2fc87bf1b0 tempest-CreateVolumesFromSnapshotTest-899706040 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:26:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ca42771b-0469-442a-aa10-ec2fc87bf1b0 tempest-CreateVolumesFromSnapshotTest-899706040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-44039bfb-38a1-4a5d-aa1e-85626b22a54e 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:26 devstack sudo[93535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-44039bfb-38a1-4a5d-aa1e-85626b22a54e 1073741824 Apr 28 19:26:26 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-513f934d-2e58-4bc5-9ae3-5653a62eea18 tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e4a058e-f413-499b-9330-da3c15b682d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc5357b5-364c-4ce8-9a59-e1f722cef8fd', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:26 devstack sudo[93535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:26 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-513f934d-2e58-4bc5-9ae3-5653a62eea18 tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c85aa605-b7df-456b-983d-042f8e46774f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:26 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-513f934d-2e58-4bc5-9ae3-5653a62eea18 tempest-CreateVolumesFromSnapshotTest-899706040 None] Volume volume-bc5357b5-364c-4ce8-9a59-e1f722cef8fd (bc5357b5-364c-4ce8-9a59-e1f722cef8fd): created successfully Apr 28 19:26:26 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-513f934d-2e58-4bc5-9ae3-5653a62eea18 tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c85aa605-b7df-456b-983d-042f8e46774f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:26 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-513f934d-2e58-4bc5-9ae3-5653a62eea18 tempest-CreateVolumesFromSnapshotTest-899706040 None] Flow 'volume_create_manager' (7eb64961-18f7-47f1-8045-6fef9356727a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:26:26 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-513f934d-2e58-4bc5-9ae3-5653a62eea18 tempest-CreateVolumesFromSnapshotTest-899706040 None] Created volume successfully. Apr 28 19:26:26 devstack sudo[93532]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-32fdafdc-5dea-4b87-8175-fe7ab2512a6e tempest-CreateVolumesFromImageTest-1883144102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-fe1316e8-1a63-4d95-8120-70cd4d93df8c" returned: 0 in 0.619s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:26 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-32fdafdc-5dea-4b87-8175-fe7ab2512a6e tempest-CreateVolumesFromImageTest-1883144102 None] Lock "cinder-quobyte-fe1316e8-1a63-4d95-8120-70cd4d93df8c" released by "delete_volume" :: held 1.409s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:26:26 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-32fdafdc-5dea-4b87-8175-fe7ab2512a6e tempest-CreateVolumesFromImageTest-1883144102 None] Created reservations ['b826ea81-d20a-4c45-8c12-57c81f842e40', '6c1ee12c-e128-47b5-90f4-19043d4a91ff', 'ed82ac47-4eda-4abe-b690-a72d6bd3f335', 'bf6c8c25-490a-42e0-88ff-117961296b80'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:26:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-32fdafdc-5dea-4b87-8175-fe7ab2512a6e tempest-CreateVolumesFromImageTest-1883144102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-32fdafdc-5dea-4b87-8175-fe7ab2512a6e tempest-CreateVolumesFromImageTest-1883144102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:26 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-32fdafdc-5dea-4b87-8175-fe7ab2512a6e tempest-CreateVolumesFromImageTest-1883144102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:26:26 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-32fdafdc-5dea-4b87-8175-fe7ab2512a6e tempest-CreateVolumesFromImageTest-1883144102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:26:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-32fdafdc-5dea-4b87-8175-fe7ab2512a6e tempest-CreateVolumesFromImageTest-1883144102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-32fdafdc-5dea-4b87-8175-fe7ab2512a6e tempest-CreateVolumesFromImageTest-1883144102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:26 devstack sudo[93541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:26:26 devstack sudo[93541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:27 devstack sudo[93535]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ca42771b-0469-442a-aa10-ec2fc87bf1b0 tempest-CreateVolumesFromSnapshotTest-899706040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-44039bfb-38a1-4a5d-aa1e-85626b22a54e 1073741824" returned: 0 in 0.846s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ca42771b-0469-442a-aa10-ec2fc87bf1b0 tempest-CreateVolumesFromSnapshotTest-899706040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-44039bfb-38a1-4a5d-aa1e-85626b22a54e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:27 devstack sudo[93543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-44039bfb-38a1-4a5d-aa1e-85626b22a54e Apr 28 19:26:27 devstack sudo[93543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:27 devstack sudo[93541]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-32fdafdc-5dea-4b87-8175-fe7ab2512a6e tempest-CreateVolumesFromImageTest-1883144102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.630s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:27 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-32fdafdc-5dea-4b87-8175-fe7ab2512a6e tempest-CreateVolumesFromImageTest-1883144102 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:26:27 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-32fdafdc-5dea-4b87-8175-fe7ab2512a6e tempest-CreateVolumesFromImageTest-1883144102 None] Deleted volume successfully. Apr 28 19:26:27 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-32fdafdc-5dea-4b87-8175-fe7ab2512a6e tempest-CreateVolumesFromImageTest-1883144102 None] Lock "cinder-fe1316e8-1a63-4d95-8120-70cd4d93df8c-delete_volume" released by "delete_volume" :: held 2.291s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:26:27 devstack sudo[93543]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ca42771b-0469-442a-aa10-ec2fc87bf1b0 tempest-CreateVolumesFromSnapshotTest-899706040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-44039bfb-38a1-4a5d-aa1e-85626b22a54e" returned: 0 in 0.625s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:27 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ca42771b-0469-442a-aa10-ec2fc87bf1b0 tempest-CreateVolumesFromSnapshotTest-899706040 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:26:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ca42771b-0469-442a-aa10-ec2fc87bf1b0 tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ea3df258-1e81-423c-aebe-de9a7a09190f tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.283s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:27 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ea3df258-1e81-423c-aebe-de9a7a09190f tempest-CreateVolumesFromSnapshotTest-899706040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:26:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-770484689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fe74f0a-18c0-4849-a299-c9faf98cf659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec9c30e85d743d1bebeb058dbf67aff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:26:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:26:21Z,use_quota=True,user_id='6368d1e0ff4b4d2e9057b330a940de2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:26:27 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-ea3df258-1e81-423c-aebe-de9a7a09190f tempest-CreateVolumesFromSnapshotTest-899706040 None] Creating volume 0fe74f0a-18c0-4849-a299-c9faf98cf659 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:26:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ea3df258-1e81-423c-aebe-de9a7a09190f tempest-CreateVolumesFromSnapshotTest-899706040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ea3df258-1e81-423c-aebe-de9a7a09190f tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:27 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ea3df258-1e81-423c-aebe-de9a7a09190f tempest-CreateVolumesFromSnapshotTest-899706040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:26:27 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ea3df258-1e81-423c-aebe-de9a7a09190f tempest-CreateVolumesFromSnapshotTest-899706040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:26:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ea3df258-1e81-423c-aebe-de9a7a09190f tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:27 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ea3df258-1e81-423c-aebe-de9a7a09190f tempest-CreateVolumesFromSnapshotTest-899706040 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:26:27 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-ea3df258-1e81-423c-aebe-de9a7a09190f tempest-CreateVolumesFromSnapshotTest-899706040 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:26:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ea3df258-1e81-423c-aebe-de9a7a09190f tempest-CreateVolumesFromSnapshotTest-899706040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-0fe74f0a-18c0-4849-a299-c9faf98cf659 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:27 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ca42771b-0469-442a-aa10-ec2fc87bf1b0 tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c73b025a-24af-49bb-af93-a323a397b181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44039bfb-38a1-4a5d-aa1e-85626b22a54e', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:27 devstack sudo[93547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-0fe74f0a-18c0-4849-a299-c9faf98cf659 1073741824 Apr 28 19:26:27 devstack sudo[93547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:27 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ca42771b-0469-442a-aa10-ec2fc87bf1b0 tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a8f6d6c-51c7-44b4-8b15-e38e9cf47c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:27 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-ca42771b-0469-442a-aa10-ec2fc87bf1b0 tempest-CreateVolumesFromSnapshotTest-899706040 None] Volume volume-44039bfb-38a1-4a5d-aa1e-85626b22a54e (44039bfb-38a1-4a5d-aa1e-85626b22a54e): created successfully Apr 28 19:26:27 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ca42771b-0469-442a-aa10-ec2fc87bf1b0 tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a8f6d6c-51c7-44b4-8b15-e38e9cf47c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:27 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ca42771b-0469-442a-aa10-ec2fc87bf1b0 tempest-CreateVolumesFromSnapshotTest-899706040 None] Flow 'volume_create_manager' (6023af90-49fc-4eff-8b9d-f536aef4f55c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:26:27 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-ca42771b-0469-442a-aa10-ec2fc87bf1b0 tempest-CreateVolumesFromSnapshotTest-899706040 None] Created volume successfully. Apr 28 19:26:28 devstack sudo[93547]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ea3df258-1e81-423c-aebe-de9a7a09190f tempest-CreateVolumesFromSnapshotTest-899706040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-0fe74f0a-18c0-4849-a299-c9faf98cf659 1073741824" returned: 0 in 0.881s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ea3df258-1e81-423c-aebe-de9a7a09190f tempest-CreateVolumesFromSnapshotTest-899706040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-0fe74f0a-18c0-4849-a299-c9faf98cf659 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:28 devstack sudo[93552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-0fe74f0a-18c0-4849-a299-c9faf98cf659 Apr 28 19:26:28 devstack sudo[93552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:29 devstack sudo[93552]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ea3df258-1e81-423c-aebe-de9a7a09190f tempest-CreateVolumesFromSnapshotTest-899706040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-0fe74f0a-18c0-4849-a299-c9faf98cf659" returned: 0 in 0.645s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:29 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ea3df258-1e81-423c-aebe-de9a7a09190f tempest-CreateVolumesFromSnapshotTest-899706040 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:26:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ea3df258-1e81-423c-aebe-de9a7a09190f tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-448fe4b7-7e8d-4dc5-b0be-3824753e5742 tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.525s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:29 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-448fe4b7-7e8d-4dc5-b0be-3824753e5742 tempest-CreateVolumesFromSnapshotTest-899706040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:26:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-859168570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b36bfc1-679d-430b-9f57-f0c21934ba00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec9c30e85d743d1bebeb058dbf67aff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:26:22Z,use_quota=True,user_id='6368d1e0ff4b4d2e9057b330a940de2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:26:29 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-448fe4b7-7e8d-4dc5-b0be-3824753e5742 tempest-CreateVolumesFromSnapshotTest-899706040 None] Creating volume 5b36bfc1-679d-430b-9f57-f0c21934ba00 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:26:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-448fe4b7-7e8d-4dc5-b0be-3824753e5742 tempest-CreateVolumesFromSnapshotTest-899706040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-448fe4b7-7e8d-4dc5-b0be-3824753e5742 tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:29 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-448fe4b7-7e8d-4dc5-b0be-3824753e5742 tempest-CreateVolumesFromSnapshotTest-899706040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:26:29 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-448fe4b7-7e8d-4dc5-b0be-3824753e5742 tempest-CreateVolumesFromSnapshotTest-899706040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:26:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-448fe4b7-7e8d-4dc5-b0be-3824753e5742 tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:29 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-448fe4b7-7e8d-4dc5-b0be-3824753e5742 tempest-CreateVolumesFromSnapshotTest-899706040 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:26:29 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-448fe4b7-7e8d-4dc5-b0be-3824753e5742 tempest-CreateVolumesFromSnapshotTest-899706040 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:26:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-448fe4b7-7e8d-4dc5-b0be-3824753e5742 tempest-CreateVolumesFromSnapshotTest-899706040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5b36bfc1-679d-430b-9f57-f0c21934ba00 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:29 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ea3df258-1e81-423c-aebe-de9a7a09190f tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db4b7235-682b-4efe-bbb1-808ab007f721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fe74f0a-18c0-4849-a299-c9faf98cf659', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:29 devstack sudo[93555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5b36bfc1-679d-430b-9f57-f0c21934ba00 1073741824 Apr 28 19:26:29 devstack sudo[93555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:29 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ea3df258-1e81-423c-aebe-de9a7a09190f tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad33930c-2ffa-4384-9dd0-56c4f6e7341d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:29 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-ea3df258-1e81-423c-aebe-de9a7a09190f tempest-CreateVolumesFromSnapshotTest-899706040 None] Volume volume-0fe74f0a-18c0-4849-a299-c9faf98cf659 (0fe74f0a-18c0-4849-a299-c9faf98cf659): created successfully Apr 28 19:26:29 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ea3df258-1e81-423c-aebe-de9a7a09190f tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad33930c-2ffa-4384-9dd0-56c4f6e7341d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:29 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ea3df258-1e81-423c-aebe-de9a7a09190f tempest-CreateVolumesFromSnapshotTest-899706040 None] Flow 'volume_create_manager' (8ecbc2c7-a74d-4f7b-9e17-e81c425bd696) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:26:29 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-ea3df258-1e81-423c-aebe-de9a7a09190f tempest-CreateVolumesFromSnapshotTest-899706040 None] Created volume successfully. Apr 28 19:26:30 devstack sudo[93555]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-448fe4b7-7e8d-4dc5-b0be-3824753e5742 tempest-CreateVolumesFromSnapshotTest-899706040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5b36bfc1-679d-430b-9f57-f0c21934ba00 1073741824" returned: 0 in 0.848s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-448fe4b7-7e8d-4dc5-b0be-3824753e5742 tempest-CreateVolumesFromSnapshotTest-899706040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5b36bfc1-679d-430b-9f57-f0c21934ba00 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:30 devstack sudo[93561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5b36bfc1-679d-430b-9f57-f0c21934ba00 Apr 28 19:26:30 devstack sudo[93561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:30 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8a6424f-fd12-498c-970f-987eb9793b17 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:26:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b8a6424f-fd12-498c-970f-987eb9793b17 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Flow 'volume_create_manager' (f68207d6-f25f-4878-a086-9814e99f8b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:26:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b8a6424f-fd12-498c-970f-987eb9793b17 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1032361b-807c-4727-b576-2677dbe708b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b8a6424f-fd12-498c-970f-987eb9793b17 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1032361b-807c-4727-b576-2677dbe708b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-465835652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49f9e81d-937d-422a-82fc-2eb2f9de5ebf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b5bddd1bcc4323baf898a53931cbe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:26:30Z,use_quota=True,user_id='034e251b5b4a40f49233502eb41915fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b8a6424f-fd12-498c-970f-987eb9793b17 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf77ea52-215e-419f-a098-279e326eb9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b8a6424f-fd12-498c-970f-987eb9793b17 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf77ea52-215e-419f-a098-279e326eb9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b8a6424f-fd12-498c-970f-987eb9793b17 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (130af042-ad02-4e33-9118-cf8a32543ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b8a6424f-fd12-498c-970f-987eb9793b17 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (130af042-ad02-4e33-9118-cf8a32543ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49f9e81d-937d-422a-82fc-2eb2f9de5ebf', 'volume_name': 'volume-49f9e81d-937d-422a-82fc-2eb2f9de5ebf', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b8a6424f-fd12-498c-970f-987eb9793b17 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f0012bc-914d-4974-b21b-982bad102c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b8a6424f-fd12-498c-970f-987eb9793b17 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f0012bc-914d-4974-b21b-982bad102c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b8a6424f-fd12-498c-970f-987eb9793b17 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dcccfd0-f9da-4fec-82f0-22df4e4e4bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:30 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-b8a6424f-fd12-498c-970f-987eb9793b17 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Volume 49f9e81d-937d-422a-82fc-2eb2f9de5ebf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49f9e81d-937d-422a-82fc-2eb2f9de5ebf', 'volume_size': 1} Apr 28 19:26:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b8a6424f-fd12-498c-970f-987eb9793b17 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:30 devstack sudo[93561]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-448fe4b7-7e8d-4dc5-b0be-3824753e5742 tempest-CreateVolumesFromSnapshotTest-899706040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5b36bfc1-679d-430b-9f57-f0c21934ba00" returned: 0 in 0.616s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:30 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-448fe4b7-7e8d-4dc5-b0be-3824753e5742 tempest-CreateVolumesFromSnapshotTest-899706040 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:26:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-448fe4b7-7e8d-4dc5-b0be-3824753e5742 tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0d4a60c9-dcf1-4f1a-b2d4-aa33beec2cbe tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.480s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:30 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0d4a60c9-dcf1-4f1a-b2d4-aa33beec2cbe tempest-CreateVolumesFromSnapshotTest-899706040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1657763273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74c4569b-39ad-4662-b92e-80f43cfeee06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec9c30e85d743d1bebeb058dbf67aff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:26:22Z,use_quota=True,user_id='6368d1e0ff4b4d2e9057b330a940de2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:26:30 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-0d4a60c9-dcf1-4f1a-b2d4-aa33beec2cbe tempest-CreateVolumesFromSnapshotTest-899706040 None] Creating volume 74c4569b-39ad-4662-b92e-80f43cfeee06 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:26:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0d4a60c9-dcf1-4f1a-b2d4-aa33beec2cbe tempest-CreateVolumesFromSnapshotTest-899706040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0d4a60c9-dcf1-4f1a-b2d4-aa33beec2cbe tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:30 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0d4a60c9-dcf1-4f1a-b2d4-aa33beec2cbe tempest-CreateVolumesFromSnapshotTest-899706040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:26:30 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0d4a60c9-dcf1-4f1a-b2d4-aa33beec2cbe tempest-CreateVolumesFromSnapshotTest-899706040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:26:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0d4a60c9-dcf1-4f1a-b2d4-aa33beec2cbe tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:30 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0d4a60c9-dcf1-4f1a-b2d4-aa33beec2cbe tempest-CreateVolumesFromSnapshotTest-899706040 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:26:30 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-0d4a60c9-dcf1-4f1a-b2d4-aa33beec2cbe tempest-CreateVolumesFromSnapshotTest-899706040 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:26:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0d4a60c9-dcf1-4f1a-b2d4-aa33beec2cbe tempest-CreateVolumesFromSnapshotTest-899706040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-74c4569b-39ad-4662-b92e-80f43cfeee06 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:30 devstack sudo[93564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-74c4569b-39ad-4662-b92e-80f43cfeee06 1073741824 Apr 28 19:26:30 devstack sudo[93564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-448fe4b7-7e8d-4dc5-b0be-3824753e5742 tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92eccd48-79c2-4dc4-87de-d650a5a9d896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b36bfc1-679d-430b-9f57-f0c21934ba00', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-448fe4b7-7e8d-4dc5-b0be-3824753e5742 tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30327b11-70dd-4a81-9458-2da92f28a7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:30 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-448fe4b7-7e8d-4dc5-b0be-3824753e5742 tempest-CreateVolumesFromSnapshotTest-899706040 None] Volume volume-5b36bfc1-679d-430b-9f57-f0c21934ba00 (5b36bfc1-679d-430b-9f57-f0c21934ba00): created successfully Apr 28 19:26:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-448fe4b7-7e8d-4dc5-b0be-3824753e5742 tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30327b11-70dd-4a81-9458-2da92f28a7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-448fe4b7-7e8d-4dc5-b0be-3824753e5742 tempest-CreateVolumesFromSnapshotTest-899706040 None] Flow 'volume_create_manager' (de7cf7d2-3c98-4df0-81da-e7a713cc82a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:26:30 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-448fe4b7-7e8d-4dc5-b0be-3824753e5742 tempest-CreateVolumesFromSnapshotTest-899706040 None] Created volume successfully. Apr 28 19:26:31 devstack sudo[93564]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0d4a60c9-dcf1-4f1a-b2d4-aa33beec2cbe tempest-CreateVolumesFromSnapshotTest-899706040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-74c4569b-39ad-4662-b92e-80f43cfeee06 1073741824" returned: 0 in 0.765s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0d4a60c9-dcf1-4f1a-b2d4-aa33beec2cbe tempest-CreateVolumesFromSnapshotTest-899706040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-74c4569b-39ad-4662-b92e-80f43cfeee06 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:31 devstack sudo[93571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-74c4569b-39ad-4662-b92e-80f43cfeee06 Apr 28 19:26:31 devstack sudo[93571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:32 devstack sudo[93571]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0d4a60c9-dcf1-4f1a-b2d4-aa33beec2cbe tempest-CreateVolumesFromSnapshotTest-899706040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-74c4569b-39ad-4662-b92e-80f43cfeee06" returned: 0 in 0.592s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:32 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0d4a60c9-dcf1-4f1a-b2d4-aa33beec2cbe tempest-CreateVolumesFromSnapshotTest-899706040 None] <== create_volume: return (1395ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:26:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0d4a60c9-dcf1-4f1a-b2d4-aa33beec2cbe tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.400s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a78696f3-e098-4555-a818-6ce47f760392 tempest-SnapshotDependencyTests-840224214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.309s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:32 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a78696f3-e098-4555-a818-6ce47f760392 tempest-SnapshotDependencyTests-840224214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1122356546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10db6bdd-2497-44a9-8434-15c06d8d00eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94aade7cbe8549f2a36923e04b232ad0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:26:24Z,use_quota=True,user_id='3246233ee2dd480b8a54a4267f9c4538',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:26:32 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-a78696f3-e098-4555-a818-6ce47f760392 tempest-SnapshotDependencyTests-840224214 None] Creating volume 10db6bdd-2497-44a9-8434-15c06d8d00eb {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:26:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a78696f3-e098-4555-a818-6ce47f760392 tempest-SnapshotDependencyTests-840224214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a78696f3-e098-4555-a818-6ce47f760392 tempest-SnapshotDependencyTests-840224214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:32 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a78696f3-e098-4555-a818-6ce47f760392 tempest-SnapshotDependencyTests-840224214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:26:32 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a78696f3-e098-4555-a818-6ce47f760392 tempest-SnapshotDependencyTests-840224214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:26:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a78696f3-e098-4555-a818-6ce47f760392 tempest-SnapshotDependencyTests-840224214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:32 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a78696f3-e098-4555-a818-6ce47f760392 tempest-SnapshotDependencyTests-840224214 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:26:32 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-a78696f3-e098-4555-a818-6ce47f760392 tempest-SnapshotDependencyTests-840224214 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:26:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a78696f3-e098-4555-a818-6ce47f760392 tempest-SnapshotDependencyTests-840224214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:32 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0d4a60c9-dcf1-4f1a-b2d4-aa33beec2cbe tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3588508-073c-4042-8c29-92ff7f24e57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74c4569b-39ad-4662-b92e-80f43cfeee06', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:32 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0d4a60c9-dcf1-4f1a-b2d4-aa33beec2cbe tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90f7f4ac-976e-494d-a18b-0ff234564b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:32 devstack sudo[93574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb 1073741824 Apr 28 19:26:32 devstack sudo[93574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:32 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-0d4a60c9-dcf1-4f1a-b2d4-aa33beec2cbe tempest-CreateVolumesFromSnapshotTest-899706040 None] Volume volume-74c4569b-39ad-4662-b92e-80f43cfeee06 (74c4569b-39ad-4662-b92e-80f43cfeee06): created successfully Apr 28 19:26:32 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0d4a60c9-dcf1-4f1a-b2d4-aa33beec2cbe tempest-CreateVolumesFromSnapshotTest-899706040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90f7f4ac-976e-494d-a18b-0ff234564b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:32 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0d4a60c9-dcf1-4f1a-b2d4-aa33beec2cbe tempest-CreateVolumesFromSnapshotTest-899706040 None] Flow 'volume_create_manager' (c70dc8d0-f9fa-49fb-954b-3e2f73979134) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:26:32 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-0d4a60c9-dcf1-4f1a-b2d4-aa33beec2cbe tempest-CreateVolumesFromSnapshotTest-899706040 None] Created volume successfully. Apr 28 19:26:33 devstack sudo[93574]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a78696f3-e098-4555-a818-6ce47f760392 tempest-SnapshotDependencyTests-840224214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb 1073741824" returned: 0 in 0.752s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a78696f3-e098-4555-a818-6ce47f760392 tempest-SnapshotDependencyTests-840224214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:33 devstack sudo[93580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb Apr 28 19:26:33 devstack sudo[93580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:33 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2413c48f-9efd-4011-8842-960108e28589 tempest-CreateVolumesFromSnapshotTest-899706040 None] Acquiring lock "cinder-74c4569b-39ad-4662-b92e-80f43cfeee06-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:26:33 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2413c48f-9efd-4011-8842-960108e28589 tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "cinder-74c4569b-39ad-4662-b92e-80f43cfeee06-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:26:33 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2413c48f-9efd-4011-8842-960108e28589 tempest-CreateVolumesFromSnapshotTest-899706040 None] Acquiring lock "cinder-quobyte-74c4569b-39ad-4662-b92e-80f43cfeee06" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:26:33 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2413c48f-9efd-4011-8842-960108e28589 tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "cinder-quobyte-74c4569b-39ad-4662-b92e-80f43cfeee06" acquired by "delete_volume" :: waited 0.016s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:26:33 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26df3b9-3029-4725-95db-2f4673559b3b]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:26:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2413c48f-9efd-4011-8842-960108e28589 tempest-CreateVolumesFromSnapshotTest-899706040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-74c4569b-39ad-4662-b92e-80f43cfeee06 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:33 devstack sudo[93582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-74c4569b-39ad-4662-b92e-80f43cfeee06 Apr 28 19:26:33 devstack sudo[93582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:33 devstack sudo[93580]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a78696f3-e098-4555-a818-6ce47f760392 tempest-SnapshotDependencyTests-840224214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb" returned: 0 in 0.624s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a78696f3-e098-4555-a818-6ce47f760392 tempest-SnapshotDependencyTests-840224214 None] <== create_volume: return (1417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:26:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a78696f3-e098-4555-a818-6ce47f760392 tempest-SnapshotDependencyTests-840224214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.422s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 8.157s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:33 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] Acquiring lock "cinder-quobyte-45ed5f04-b689-4b24-8f9c-ec22ee4ac585-9fb322f0-db37-4367-a796-8a5ca80515c4" by "_create_volume_from_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:26:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a78696f3-e098-4555-a818-6ce47f760392 tempest-SnapshotDependencyTests-840224214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a1f80bf-1750-40fa-b19a-76d45cf1bea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10db6bdd-2497-44a9-8434-15c06d8d00eb', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a78696f3-e098-4555-a818-6ce47f760392 tempest-SnapshotDependencyTests-840224214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9e2363a-f5e1-4e85-b782-5aaddb58eaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:33 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] Lock "cinder-quobyte-45ed5f04-b689-4b24-8f9c-ec22ee4ac585-9fb322f0-db37-4367-a796-8a5ca80515c4" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:26:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] Creating volume 9fb322f0-db37-4367-a796-8a5ca80515c4 from snapshot 45ed5f04-b689-4b24-8f9c-ec22ee4ac585 {{(pid=83863) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 28 19:26:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:26:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:26:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:26:33 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] Acquiring lock "cinder-quobyte-9fb322f0-db37-4367-a796-8a5ca80515c4" by "_copy_volume_from_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:26:33 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-a78696f3-e098-4555-a818-6ce47f760392 tempest-SnapshotDependencyTests-840224214 None] Volume volume-10db6bdd-2497-44a9-8434-15c06d8d00eb (10db6bdd-2497-44a9-8434-15c06d8d00eb): created successfully Apr 28 19:26:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a78696f3-e098-4555-a818-6ce47f760392 tempest-SnapshotDependencyTests-840224214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9e2363a-f5e1-4e85-b782-5aaddb58eaab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a78696f3-e098-4555-a818-6ce47f760392 tempest-SnapshotDependencyTests-840224214 None] Flow 'volume_create_manager' (006f34bb-1df4-4ae8-b208-fdd86181d32a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:26:33 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] Lock "cinder-quobyte-9fb322f0-db37-4367-a796-8a5ca80515c4" acquired by "_copy_volume_from_snapshot" :: waited 0.043s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:26:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] snapshot: 45ed5f04-b689-4b24-8f9c-ec22ee4ac585, volume: 9fb322f0-db37-4367-a796-8a5ca80515c4, {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 19:26:33 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-a78696f3-e098-4555-a818-6ce47f760392 tempest-SnapshotDependencyTests-840224214 None] Created volume successfully. Apr 28 19:26:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:26:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:26:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:33 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d522eea-6085-4c23-b063-3ed47828af89]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:26:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45.45ed5f04-b689-4b24-8f9c-ec22ee4ac585 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:33 devstack sudo[93585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45.45ed5f04-b689-4b24-8f9c-ec22ee4ac585 Apr 28 19:26:33 devstack sudo[93585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:33 devstack sudo[93582]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2413c48f-9efd-4011-8842-960108e28589 tempest-CreateVolumesFromSnapshotTest-899706040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-74c4569b-39ad-4662-b92e-80f43cfeee06" returned: 0 in 0.744s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2413c48f-9efd-4011-8842-960108e28589 tempest-CreateVolumesFromSnapshotTest-899706040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-74c4569b-39ad-4662-b92e-80f43cfeee06 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:34 devstack sudo[93590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-74c4569b-39ad-4662-b92e-80f43cfeee06 Apr 28 19:26:34 devstack sudo[93590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:34 devstack sudo[93585]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45.45ed5f04-b689-4b24-8f9c-ec22ee4ac585" returned: 0 in 0.769s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:34 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:26:34 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45 {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 19:26:34 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] Creating direct copy from snapshot {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 19:26:34 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0191c413-50ab-426c-a770-79ef68473da0]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:26:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:34 devstack sudo[93590]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2413c48f-9efd-4011-8842-960108e28589 tempest-CreateVolumesFromSnapshotTest-899706040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-74c4569b-39ad-4662-b92e-80f43cfeee06" returned: 0 in 0.683s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:34 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2413c48f-9efd-4011-8842-960108e28589 tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "cinder-quobyte-74c4569b-39ad-4662-b92e-80f43cfeee06" released by "delete_volume" :: held 1.494s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:26:34 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-2413c48f-9efd-4011-8842-960108e28589 tempest-CreateVolumesFromSnapshotTest-899706040 None] Created reservations ['d25d1093-65d3-439a-8a1f-0fa758e5da2c', 'e15ebeaa-95f0-46e4-969c-61daca072915', '60cdb6ba-7dbf-4012-b2e4-b2bb393aa44c', '9fd3dada-d0a4-4279-a657-3da949148bec'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:26:34 devstack sudo[93596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45 Apr 28 19:26:34 devstack sudo[93596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7aaf1b08-23b1-4af7-a969-2037780ecfa1 tempest-SnapshotDependencyTests-840224214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2413c48f-9efd-4011-8842-960108e28589 tempest-CreateVolumesFromSnapshotTest-899706040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2413c48f-9efd-4011-8842-960108e28589 tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:34 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2413c48f-9efd-4011-8842-960108e28589 tempest-CreateVolumesFromSnapshotTest-899706040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:26:34 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2413c48f-9efd-4011-8842-960108e28589 tempest-CreateVolumesFromSnapshotTest-899706040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:26:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2413c48f-9efd-4011-8842-960108e28589 tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2413c48f-9efd-4011-8842-960108e28589 tempest-CreateVolumesFromSnapshotTest-899706040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:34 devstack sudo[93598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:26:34 devstack sudo[93598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:35 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6bc0cb13-97c7-4198-9ff0-ade5d20f4f07 tempest-CreateVolumesFromSnapshotTest-899706040 None] Acquiring lock "cinder-5b36bfc1-679d-430b-9f57-f0c21934ba00-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:26:35 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6bc0cb13-97c7-4198-9ff0-ade5d20f4f07 tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "cinder-5b36bfc1-679d-430b-9f57-f0c21934ba00-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:26:35 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6bc0cb13-97c7-4198-9ff0-ade5d20f4f07 tempest-CreateVolumesFromSnapshotTest-899706040 None] Acquiring lock "cinder-quobyte-5b36bfc1-679d-430b-9f57-f0c21934ba00" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:26:35 devstack sudo[93596]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45" returned: 0 in 0.846s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:35 devstack cinder-volume[83863]: DEBUG cinder.utils [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] Path /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9fb322f0-db37-4367-a796-8a5ca80515c4 not found in is_blk_device check {{(pid=83863) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 19:26:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9fb322f0-db37-4367-a796-8a5ca80515c4 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:35 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6bc0cb13-97c7-4198-9ff0-ade5d20f4f07 tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "cinder-quobyte-5b36bfc1-679d-430b-9f57-f0c21934ba00" acquired by "delete_volume" :: waited 0.037s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:26:35 devstack sudo[93605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9fb322f0-db37-4367-a796-8a5ca80515c4 Apr 28 19:26:35 devstack sudo[93605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:35 devstack sudo[93598]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2413c48f-9efd-4011-8842-960108e28589 tempest-CreateVolumesFromSnapshotTest-899706040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.651s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:35 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-2413c48f-9efd-4011-8842-960108e28589 tempest-CreateVolumesFromSnapshotTest-899706040 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:26:35 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-2413c48f-9efd-4011-8842-960108e28589 tempest-CreateVolumesFromSnapshotTest-899706040 None] Deleted volume successfully. Apr 28 19:26:35 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8dc851a-909d-4af4-995e-530c115adefe]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:26:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6bc0cb13-97c7-4198-9ff0-ade5d20f4f07 tempest-CreateVolumesFromSnapshotTest-899706040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5b36bfc1-679d-430b-9f57-f0c21934ba00 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:35 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2413c48f-9efd-4011-8842-960108e28589 tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "cinder-74c4569b-39ad-4662-b92e-80f43cfeee06-delete_volume" released by "delete_volume" :: held 2.404s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:26:35 devstack sudo[93607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5b36bfc1-679d-430b-9f57-f0c21934ba00 Apr 28 19:26:35 devstack sudo[93607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:36 devstack sudo[93607]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6bc0cb13-97c7-4198-9ff0-ade5d20f4f07 tempest-CreateVolumesFromSnapshotTest-899706040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5b36bfc1-679d-430b-9f57-f0c21934ba00" returned: 0 in 0.905s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6bc0cb13-97c7-4198-9ff0-ade5d20f4f07 tempest-CreateVolumesFromSnapshotTest-899706040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5b36bfc1-679d-430b-9f57-f0c21934ba00 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:36 devstack sudo[93623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5b36bfc1-679d-430b-9f57-f0c21934ba00 Apr 28 19:26:36 devstack sudo[93623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:37 devstack sudo[93623]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6bc0cb13-97c7-4198-9ff0-ade5d20f4f07 tempest-CreateVolumesFromSnapshotTest-899706040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-5b36bfc1-679d-430b-9f57-f0c21934ba00" returned: 0 in 1.413s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:37 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6bc0cb13-97c7-4198-9ff0-ade5d20f4f07 tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "cinder-quobyte-5b36bfc1-679d-430b-9f57-f0c21934ba00" released by "delete_volume" :: held 2.393s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:26:37 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-6bc0cb13-97c7-4198-9ff0-ade5d20f4f07 tempest-CreateVolumesFromSnapshotTest-899706040 None] Created reservations ['a628c094-8907-4c66-a1cb-f0971f3771df', 'dd3d63b6-2718-4e57-a293-55a818db5725', '4a7ed5e7-6cbc-4907-abd2-6ebc4b6e01bb', '27624ec6-f169-480c-a6a9-c9199ef530c3'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:26:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6bc0cb13-97c7-4198-9ff0-ade5d20f4f07 tempest-CreateVolumesFromSnapshotTest-899706040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6bc0cb13-97c7-4198-9ff0-ade5d20f4f07 tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:38 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6bc0cb13-97c7-4198-9ff0-ade5d20f4f07 tempest-CreateVolumesFromSnapshotTest-899706040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:26:38 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6bc0cb13-97c7-4198-9ff0-ade5d20f4f07 tempest-CreateVolumesFromSnapshotTest-899706040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:26:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6bc0cb13-97c7-4198-9ff0-ade5d20f4f07 tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6bc0cb13-97c7-4198-9ff0-ade5d20f4f07 tempest-CreateVolumesFromSnapshotTest-899706040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:38 devstack sudo[93627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:26:38 devstack sudo[93627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:39 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c641509c-ee8a-4481-a27d-cdee6b9b3ba3 tempest-CreateVolumesFromSnapshotTest-899706040 None] Acquiring lock "cinder-0fe74f0a-18c0-4849-a299-c9faf98cf659-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:26:39 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c641509c-ee8a-4481-a27d-cdee6b9b3ba3 tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "cinder-0fe74f0a-18c0-4849-a299-c9faf98cf659-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:26:39 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c641509c-ee8a-4481-a27d-cdee6b9b3ba3 tempest-CreateVolumesFromSnapshotTest-899706040 None] Acquiring lock "cinder-quobyte-0fe74f0a-18c0-4849-a299-c9faf98cf659" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:26:39 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c641509c-ee8a-4481-a27d-cdee6b9b3ba3 tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "cinder-quobyte-0fe74f0a-18c0-4849-a299-c9faf98cf659" acquired by "delete_volume" :: waited 0.058s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:26:39 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[abed1152-fe4f-4209-a2f6-e3cd15a91ab5]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:26:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c641509c-ee8a-4481-a27d-cdee6b9b3ba3 tempest-CreateVolumesFromSnapshotTest-899706040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-0fe74f0a-18c0-4849-a299-c9faf98cf659 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:39 devstack sudo[93627]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6bc0cb13-97c7-4198-9ff0-ade5d20f4f07 tempest-CreateVolumesFromSnapshotTest-899706040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 1.467s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:39 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-6bc0cb13-97c7-4198-9ff0-ade5d20f4f07 tempest-CreateVolumesFromSnapshotTest-899706040 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:26:39 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-6bc0cb13-97c7-4198-9ff0-ade5d20f4f07 tempest-CreateVolumesFromSnapshotTest-899706040 None] Deleted volume successfully. Apr 28 19:26:39 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6bc0cb13-97c7-4198-9ff0-ade5d20f4f07 tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "cinder-5b36bfc1-679d-430b-9f57-f0c21934ba00-delete_volume" released by "delete_volume" :: held 4.339s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:26:39 devstack sudo[93664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-0fe74f0a-18c0-4849-a299-c9faf98cf659 Apr 28 19:26:39 devstack sudo[93664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:41 devstack sudo[93664]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c641509c-ee8a-4481-a27d-cdee6b9b3ba3 tempest-CreateVolumesFromSnapshotTest-899706040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-0fe74f0a-18c0-4849-a299-c9faf98cf659" returned: 0 in 1.536s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c641509c-ee8a-4481-a27d-cdee6b9b3ba3 tempest-CreateVolumesFromSnapshotTest-899706040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-0fe74f0a-18c0-4849-a299-c9faf98cf659 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:41 devstack sudo[93672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-0fe74f0a-18c0-4849-a299-c9faf98cf659 Apr 28 19:26:41 devstack sudo[93672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:41 devstack sudo[93605]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9fb322f0-db37-4367-a796-8a5ca80515c4" returned: 0 in 5.596s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:41 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[015458c2-8723-423c-8f86-8030c45626ac]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:26:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:41 devstack sudo[93674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45 Apr 28 19:26:41 devstack sudo[93674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:41 devstack sudo[93672]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c641509c-ee8a-4481-a27d-cdee6b9b3ba3 tempest-CreateVolumesFromSnapshotTest-899706040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-0fe74f0a-18c0-4849-a299-c9faf98cf659" returned: 0 in 0.640s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:41 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c641509c-ee8a-4481-a27d-cdee6b9b3ba3 tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "cinder-quobyte-0fe74f0a-18c0-4849-a299-c9faf98cf659" released by "delete_volume" :: held 2.280s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:26:41 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-c641509c-ee8a-4481-a27d-cdee6b9b3ba3 tempest-CreateVolumesFromSnapshotTest-899706040 None] Created reservations ['6665a231-56aa-4d7b-b72f-64b2098449cc', 'c951ac50-5055-476d-8b8f-3b32bb85d3b4', '3f0b408c-284c-4874-8af3-c7281820c622', 'f6fdaa37-2496-4942-b138-c16f6ed17740'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:26:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c641509c-ee8a-4481-a27d-cdee6b9b3ba3 tempest-CreateVolumesFromSnapshotTest-899706040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c641509c-ee8a-4481-a27d-cdee6b9b3ba3 tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:41 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c641509c-ee8a-4481-a27d-cdee6b9b3ba3 tempest-CreateVolumesFromSnapshotTest-899706040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:26:41 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c641509c-ee8a-4481-a27d-cdee6b9b3ba3 tempest-CreateVolumesFromSnapshotTest-899706040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:26:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c641509c-ee8a-4481-a27d-cdee6b9b3ba3 tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c641509c-ee8a-4481-a27d-cdee6b9b3ba3 tempest-CreateVolumesFromSnapshotTest-899706040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:41 devstack sudo[93679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:26:41 devstack sudo[93679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:41 devstack sudo[93674]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45" returned: 0 in 0.879s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:41 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] Image conversion details: src /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45, size 1024.00 MB, duration 5.60 sec, destination /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9fb322f0-db37-4367-a796-8a5ca80515c4 {{(pid=83863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 19:26:41 devstack cinder-volume[83863]: INFO cinder.image.image_utils [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] Converted 1024.00 MB image at 182.95 MB/s Apr 28 19:26:41 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9fb322f0-db37-4367-a796-8a5ca80515c4 is being set with open permissions: ugo+rw Apr 28 19:26:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9fb322f0-db37-4367-a796-8a5ca80515c4 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:42 devstack sudo[93682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9fb322f0-db37-4367-a796-8a5ca80515c4 Apr 28 19:26:42 devstack sudo[93682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:42 devstack sudo[93679]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c641509c-ee8a-4481-a27d-cdee6b9b3ba3 tempest-CreateVolumesFromSnapshotTest-899706040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.611s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:42 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-c641509c-ee8a-4481-a27d-cdee6b9b3ba3 tempest-CreateVolumesFromSnapshotTest-899706040 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:26:42 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-c641509c-ee8a-4481-a27d-cdee6b9b3ba3 tempest-CreateVolumesFromSnapshotTest-899706040 None] Deleted volume successfully. Apr 28 19:26:42 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c641509c-ee8a-4481-a27d-cdee6b9b3ba3 tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "cinder-0fe74f0a-18c0-4849-a299-c9faf98cf659-delete_volume" released by "delete_volume" :: held 3.269s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:26:42 devstack sudo[93682]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9fb322f0-db37-4367-a796-8a5ca80515c4" returned: 0 in 0.629s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:42 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] Lock "cinder-quobyte-9fb322f0-db37-4367-a796-8a5ca80515c4" released by "_copy_volume_from_snapshot" :: held 8.835s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:26:42 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] Lock "cinder-quobyte-45ed5f04-b689-4b24-8f9c-ec22ee4ac585-9fb322f0-db37-4367-a796-8a5ca80515c4" released by "_create_volume_from_snapshot" :: held 8.898s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:26:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.940s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b8a6424f-fd12-498c-970f-987eb9793b17 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.039s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:42 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b8a6424f-fd12-498c-970f-987eb9793b17 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-465835652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49f9e81d-937d-422a-82fc-2eb2f9de5ebf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b5bddd1bcc4323baf898a53931cbe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:26:30Z,use_quota=True,user_id='034e251b5b4a40f49233502eb41915fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:26:42 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-b8a6424f-fd12-498c-970f-987eb9793b17 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Creating volume 49f9e81d-937d-422a-82fc-2eb2f9de5ebf {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:26:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b8a6424f-fd12-498c-970f-987eb9793b17 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b8a6424f-fd12-498c-970f-987eb9793b17 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:42 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b8a6424f-fd12-498c-970f-987eb9793b17 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:26:42 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b8a6424f-fd12-498c-970f-987eb9793b17 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:26:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b8a6424f-fd12-498c-970f-987eb9793b17 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:42 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b8a6424f-fd12-498c-970f-987eb9793b17 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:26:42 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-b8a6424f-fd12-498c-970f-987eb9793b17 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:26:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b8a6424f-fd12-498c-970f-987eb9793b17 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-49f9e81d-937d-422a-82fc-2eb2f9de5ebf 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:42 devstack sudo[93686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-49f9e81d-937d-422a-82fc-2eb2f9de5ebf 1073741824 Apr 28 19:26:42 devstack sudo[93686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:42 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4975b9df-9d30-4169-8506-805d1996c620 tempest-CreateVolumesFromSnapshotTest-899706040 None] Acquiring lock "cinder-44039bfb-38a1-4a5d-aa1e-85626b22a54e-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:26:42 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9768df7a-250b-40f8-baa5-f1b12d372717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fb322f0-db37-4367-a796-8a5ca80515c4', 'volume_size': 1, 'snapshot_id': '45ed5f04-b689-4b24-8f9c-ec22ee4ac585'}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:42 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12a0e84d-a635-4253-8b6c-36a33eab1c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:42 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4975b9df-9d30-4169-8506-805d1996c620 tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "cinder-44039bfb-38a1-4a5d-aa1e-85626b22a54e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:26:42 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] Volume volume-9fb322f0-db37-4367-a796-8a5ca80515c4 (9fb322f0-db37-4367-a796-8a5ca80515c4): created successfully Apr 28 19:26:42 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12a0e84d-a635-4253-8b6c-36a33eab1c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:42 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] Flow 'volume_create_manager' (c0dbced1-6ab2-431a-9979-5cfdbe0b5a25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:26:42 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-5ee01db0-5f3b-4b26-8d74-3abf5987793c tempest-VolumeDependencyTests-637805770 None] Created volume successfully. Apr 28 19:26:42 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4975b9df-9d30-4169-8506-805d1996c620 tempest-CreateVolumesFromSnapshotTest-899706040 None] Acquiring lock "cinder-quobyte-44039bfb-38a1-4a5d-aa1e-85626b22a54e" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:26:42 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4975b9df-9d30-4169-8506-805d1996c620 tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "cinder-quobyte-44039bfb-38a1-4a5d-aa1e-85626b22a54e" acquired by "delete_volume" :: waited 0.030s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:26:42 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee61ae4-3a5f-435d-8665-1fc68186e1b3]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:26:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4975b9df-9d30-4169-8506-805d1996c620 tempest-CreateVolumesFromSnapshotTest-899706040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-44039bfb-38a1-4a5d-aa1e-85626b22a54e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:42 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e98b7940-137d-4b77-a106-9704e1e8268e tempest-VolumeDependencyTests-637805770 None] Acquiring lock "cinder-45ed5f04-b689-4b24-8f9c-ec22ee4ac585-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:26:42 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e98b7940-137d-4b77-a106-9704e1e8268e tempest-VolumeDependencyTests-637805770 None] Lock "cinder-45ed5f04-b689-4b24-8f9c-ec22ee4ac585-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:26:42 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e98b7940-137d-4b77-a106-9704e1e8268e tempest-VolumeDependencyTests-637805770 None] Acquiring lock "cinder-quobyte-e72a8fc1-2ab4-4355-8247-f42ab18d2f45" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:26:42 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e98b7940-137d-4b77-a106-9704e1e8268e tempest-VolumeDependencyTests-637805770 None] Lock "cinder-quobyte-e72a8fc1-2ab4-4355-8247-f42ab18d2f45" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:26:42 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e98b7940-137d-4b77-a106-9704e1e8268e tempest-VolumeDependencyTests-637805770 None] Acquiring lock "cinder-quobyte-45ed5f04-b689-4b24-8f9c-ec22ee4ac585" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:26:42 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e98b7940-137d-4b77-a106-9704e1e8268e tempest-VolumeDependencyTests-637805770 None] Lock "cinder-quobyte-45ed5f04-b689-4b24-8f9c-ec22ee4ac585" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:26:42 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-e98b7940-137d-4b77-a106-9704e1e8268e tempest-VolumeDependencyTests-637805770 None] Deleting offline snapshot 45ed5f04-b689-4b24-8f9c-ec22ee4ac585 of volume e72a8fc1-2ab4-4355-8247-f42ab18d2f45 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 19:26:42 devstack sudo[93688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-44039bfb-38a1-4a5d-aa1e-85626b22a54e Apr 28 19:26:42 devstack sudo[93688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:42 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-e98b7940-137d-4b77-a106-9704e1e8268e tempest-VolumeDependencyTests-637805770 None] snapshot_file for this snap is: volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45.45ed5f04-b689-4b24-8f9c-ec22ee4ac585 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 19:26:43 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[de57ad83-489d-4324-b95e-0521915522be]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:26:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e98b7940-137d-4b77-a106-9704e1e8268e tempest-VolumeDependencyTests-637805770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45.45ed5f04-b689-4b24-8f9c-ec22ee4ac585 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:43 devstack sudo[93690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45.45ed5f04-b689-4b24-8f9c-ec22ee4ac585 Apr 28 19:26:43 devstack sudo[93690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:43 devstack sudo[93686]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b8a6424f-fd12-498c-970f-987eb9793b17 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-49f9e81d-937d-422a-82fc-2eb2f9de5ebf 1073741824" returned: 0 in 0.884s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b8a6424f-fd12-498c-970f-987eb9793b17 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-49f9e81d-937d-422a-82fc-2eb2f9de5ebf {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:43 devstack sudo[93698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-49f9e81d-937d-422a-82fc-2eb2f9de5ebf Apr 28 19:26:43 devstack sudo[93698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:43 devstack sudo[93688]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4975b9df-9d30-4169-8506-805d1996c620 tempest-CreateVolumesFromSnapshotTest-899706040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-44039bfb-38a1-4a5d-aa1e-85626b22a54e" returned: 0 in 0.794s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4975b9df-9d30-4169-8506-805d1996c620 tempest-CreateVolumesFromSnapshotTest-899706040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-44039bfb-38a1-4a5d-aa1e-85626b22a54e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:43 devstack sudo[93700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-44039bfb-38a1-4a5d-aa1e-85626b22a54e Apr 28 19:26:43 devstack sudo[93700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:43 devstack sudo[93690]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e98b7940-137d-4b77-a106-9704e1e8268e tempest-VolumeDependencyTests-637805770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45.45ed5f04-b689-4b24-8f9c-ec22ee4ac585" returned: 0 in 0.847s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:43 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-e98b7940-137d-4b77-a106-9704e1e8268e tempest-VolumeDependencyTests-637805770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:26:43 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5df1c6-a8eb-4038-80a5-ba0db638864d]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:26:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e98b7940-137d-4b77-a106-9704e1e8268e tempest-VolumeDependencyTests-637805770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:43 devstack sudo[93705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45 Apr 28 19:26:43 devstack sudo[93705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:44 devstack sudo[93698]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b8a6424f-fd12-498c-970f-987eb9793b17 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-49f9e81d-937d-422a-82fc-2eb2f9de5ebf" returned: 0 in 0.654s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:44 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b8a6424f-fd12-498c-970f-987eb9793b17 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] <== create_volume: return (1591ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:26:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b8a6424f-fd12-498c-970f-987eb9793b17 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7aaf1b08-23b1-4af7-a969-2037780ecfa1 tempest-SnapshotDependencyTests-840224214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.417s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:44 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b8a6424f-fd12-498c-970f-987eb9793b17 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dcccfd0-f9da-4fec-82f0-22df4e4e4bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49f9e81d-937d-422a-82fc-2eb2f9de5ebf', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:44 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b8a6424f-fd12-498c-970f-987eb9793b17 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43a73b35-8bc4-4470-9a09-970e1db6b9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:44 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-7aaf1b08-23b1-4af7-a969-2037780ecfa1 tempest-SnapshotDependencyTests-840224214 None] Creating offline snapshot 9d170213-559b-48bd-82b3-269609d2373d of volume 10db6bdd-2497-44a9-8434-15c06d8d00eb {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 19:26:44 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-b8a6424f-fd12-498c-970f-987eb9793b17 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Volume volume-49f9e81d-937d-422a-82fc-2eb2f9de5ebf (49f9e81d-937d-422a-82fc-2eb2f9de5ebf): created successfully Apr 28 19:26:44 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b8a6424f-fd12-498c-970f-987eb9793b17 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43a73b35-8bc4-4470-9a09-970e1db6b9e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:44 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b8a6424f-fd12-498c-970f-987eb9793b17 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Flow 'volume_create_manager' (f68207d6-f25f-4878-a086-9814e99f8b11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:26:44 devstack sudo[93700]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:44 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae15ad52-176a-4de5-a938-dec2b745c310]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:26:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7aaf1b08-23b1-4af7-a969-2037780ecfa1 tempest-SnapshotDependencyTests-840224214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4975b9df-9d30-4169-8506-805d1996c620 tempest-CreateVolumesFromSnapshotTest-899706040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-44039bfb-38a1-4a5d-aa1e-85626b22a54e" returned: 0 in 0.694s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:44 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-b8a6424f-fd12-498c-970f-987eb9793b17 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Created volume successfully. Apr 28 19:26:44 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4975b9df-9d30-4169-8506-805d1996c620 tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "cinder-quobyte-44039bfb-38a1-4a5d-aa1e-85626b22a54e" released by "delete_volume" :: held 1.540s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:26:44 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-4975b9df-9d30-4169-8506-805d1996c620 tempest-CreateVolumesFromSnapshotTest-899706040 None] Created reservations ['93fef10d-1824-4fea-84e9-ad042f953f16', '5dbcd117-6046-4020-9af4-f41312b0179a', 'b454cc1e-fff0-4868-bd95-1ec2a2155957', '6030cec7-75e4-4a39-abd5-6d817726cc01'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:26:44 devstack sudo[93709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb Apr 28 19:26:44 devstack sudo[93709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4975b9df-9d30-4169-8506-805d1996c620 tempest-CreateVolumesFromSnapshotTest-899706040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4975b9df-9d30-4169-8506-805d1996c620 tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:44 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4975b9df-9d30-4169-8506-805d1996c620 tempest-CreateVolumesFromSnapshotTest-899706040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:26:44 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4975b9df-9d30-4169-8506-805d1996c620 tempest-CreateVolumesFromSnapshotTest-899706040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:26:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4975b9df-9d30-4169-8506-805d1996c620 tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4975b9df-9d30-4169-8506-805d1996c620 tempest-CreateVolumesFromSnapshotTest-899706040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:44 devstack sudo[93711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:26:44 devstack sudo[93711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:44 devstack sudo[93705]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e98b7940-137d-4b77-a106-9704e1e8268e tempest-VolumeDependencyTests-637805770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45" returned: 0 in 0.789s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e98b7940-137d-4b77-a106-9704e1e8268e tempest-VolumeDependencyTests-637805770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45.45ed5f04-b689-4b24-8f9c-ec22ee4ac585 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:44 devstack sudo[93716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45.45ed5f04-b689-4b24-8f9c-ec22ee4ac585 Apr 28 19:26:44 devstack sudo[93716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:45 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-73a9505d-a120-4b1f-bec8-ca15b39c7e09 tempest-CreateVolumesFromSnapshotTest-899706040 None] Acquiring lock "cinder-bc5357b5-364c-4ce8-9a59-e1f722cef8fd-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:26:45 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-73a9505d-a120-4b1f-bec8-ca15b39c7e09 tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "cinder-bc5357b5-364c-4ce8-9a59-e1f722cef8fd-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:26:45 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-73a9505d-a120-4b1f-bec8-ca15b39c7e09 tempest-CreateVolumesFromSnapshotTest-899706040 None] Acquiring lock "cinder-quobyte-bc5357b5-364c-4ce8-9a59-e1f722cef8fd" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:26:45 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-73a9505d-a120-4b1f-bec8-ca15b39c7e09 tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "cinder-quobyte-bc5357b5-364c-4ce8-9a59-e1f722cef8fd" acquired by "delete_volume" :: waited 0.019s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:26:45 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22b1495-181b-4e46-9be5-8cbcadf1fc88]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:26:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-73a9505d-a120-4b1f-bec8-ca15b39c7e09 tempest-CreateVolumesFromSnapshotTest-899706040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bc5357b5-364c-4ce8-9a59-e1f722cef8fd {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:45 devstack sudo[93711]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4975b9df-9d30-4169-8506-805d1996c620 tempest-CreateVolumesFromSnapshotTest-899706040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.814s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:45 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-4975b9df-9d30-4169-8506-805d1996c620 tempest-CreateVolumesFromSnapshotTest-899706040 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:26:45 devstack sudo[93709]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:45 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-4975b9df-9d30-4169-8506-805d1996c620 tempest-CreateVolumesFromSnapshotTest-899706040 None] Deleted volume successfully. Apr 28 19:26:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7aaf1b08-23b1-4af7-a969-2037780ecfa1 tempest-SnapshotDependencyTests-840224214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb" returned: 0 in 0.984s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7aaf1b08-23b1-4af7-a969-2037780ecfa1 tempest-SnapshotDependencyTests-840224214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb.9d170213-559b-48bd-82b3-269609d2373d 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:45 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-e26c8fec-9ce7-42bd-989c-2dc6df99627a tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:26:45 devstack sudo[93723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb.9d170213-559b-48bd-82b3-269609d2373d 1G Apr 28 19:26:45 devstack sudo[93723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e26c8fec-9ce7-42bd-989c-2dc6df99627a tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Flow 'volume_create_manager' (95863ad0-64c0-4418-9b59-7beff23fa24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:26:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e26c8fec-9ce7-42bd-989c-2dc6df99627a tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ad50e23-7684-41a9-a942-4a0e5e11aeda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:45 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4975b9df-9d30-4169-8506-805d1996c620 tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "cinder-44039bfb-38a1-4a5d-aa1e-85626b22a54e-delete_volume" released by "delete_volume" :: held 2.675s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:26:45 devstack sudo[93722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bc5357b5-364c-4ce8-9a59-e1f722cef8fd Apr 28 19:26:45 devstack sudo[93722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e26c8fec-9ce7-42bd-989c-2dc6df99627a tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ad50e23-7684-41a9-a942-4a0e5e11aeda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-942536363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7528466-f088-4468-b9ba-dbafe05674d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b5bddd1bcc4323baf898a53931cbe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:26:45Z,use_quota=True,user_id='034e251b5b4a40f49233502eb41915fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e26c8fec-9ce7-42bd-989c-2dc6df99627a tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82b0ea9e-d97a-44ae-8460-80e0a1c61303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e26c8fec-9ce7-42bd-989c-2dc6df99627a tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82b0ea9e-d97a-44ae-8460-80e0a1c61303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e26c8fec-9ce7-42bd-989c-2dc6df99627a tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9e0b17a-0613-4810-848e-092d22c6d5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e26c8fec-9ce7-42bd-989c-2dc6df99627a tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9e0b17a-0613-4810-848e-092d22c6d5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7528466-f088-4468-b9ba-dbafe05674d5', 'volume_name': 'volume-d7528466-f088-4468-b9ba-dbafe05674d5', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e26c8fec-9ce7-42bd-989c-2dc6df99627a tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (926e7f40-08b0-4dff-93d5-806d1f66c4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e26c8fec-9ce7-42bd-989c-2dc6df99627a tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (926e7f40-08b0-4dff-93d5-806d1f66c4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e26c8fec-9ce7-42bd-989c-2dc6df99627a tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baef5fa8-2889-4237-b72e-0da579c50546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:45 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-e26c8fec-9ce7-42bd-989c-2dc6df99627a tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Volume d7528466-f088-4468-b9ba-dbafe05674d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7528466-f088-4468-b9ba-dbafe05674d5', 'volume_size': 1} Apr 28 19:26:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e26c8fec-9ce7-42bd-989c-2dc6df99627a tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:45 devstack sudo[93716]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e98b7940-137d-4b77-a106-9704e1e8268e tempest-VolumeDependencyTests-637805770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45.45ed5f04-b689-4b24-8f9c-ec22ee4ac585" returned: 0 in 1.014s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e98b7940-137d-4b77-a106-9704e1e8268e tempest-VolumeDependencyTests-637805770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45.45ed5f04-b689-4b24-8f9c-ec22ee4ac585 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:45 devstack sudo[93730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45.45ed5f04-b689-4b24-8f9c-ec22ee4ac585 Apr 28 19:26:45 devstack sudo[93730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:45 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-0853f3a1-d72b-410d-aa33-d68780431ffa tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:26:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0853f3a1-d72b-410d-aa33-d68780431ffa tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Flow 'volume_create_manager' (b4b0407d-926a-4858-8127-5c1eb84ad263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:26:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0853f3a1-d72b-410d-aa33-d68780431ffa tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4934af3-0513-4ce9-aa65-dd0c72e4176c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0853f3a1-d72b-410d-aa33-d68780431ffa tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4934af3-0513-4ce9-aa65-dd0c72e4176c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-632799271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2b76522-a286-4f90-adf8-43101cfd64b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b5bddd1bcc4323baf898a53931cbe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:26:46Z,use_quota=True,user_id='034e251b5b4a40f49233502eb41915fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0853f3a1-d72b-410d-aa33-d68780431ffa tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd6b5b09-4ac1-4fa3-a27b-8bcf84ec1598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0853f3a1-d72b-410d-aa33-d68780431ffa tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd6b5b09-4ac1-4fa3-a27b-8bcf84ec1598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0853f3a1-d72b-410d-aa33-d68780431ffa tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ccbcf49-ec2a-49ca-8e7b-2e0f4a7a4675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0853f3a1-d72b-410d-aa33-d68780431ffa tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ccbcf49-ec2a-49ca-8e7b-2e0f4a7a4675) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2b76522-a286-4f90-adf8-43101cfd64b1', 'volume_name': 'volume-f2b76522-a286-4f90-adf8-43101cfd64b1', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0853f3a1-d72b-410d-aa33-d68780431ffa tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5110a759-6e3d-4ee1-9bb4-b3556dcf0fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0853f3a1-d72b-410d-aa33-d68780431ffa tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5110a759-6e3d-4ee1-9bb4-b3556dcf0fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0853f3a1-d72b-410d-aa33-d68780431ffa tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3498477e-b269-4bfb-8c0c-0eaa423bd63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:45 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-0853f3a1-d72b-410d-aa33-d68780431ffa tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Volume f2b76522-a286-4f90-adf8-43101cfd64b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2b76522-a286-4f90-adf8-43101cfd64b1', 'volume_size': 1} Apr 28 19:26:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0853f3a1-d72b-410d-aa33-d68780431ffa tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:46 devstack sudo[93722]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-73a9505d-a120-4b1f-bec8-ca15b39c7e09 tempest-CreateVolumesFromSnapshotTest-899706040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bc5357b5-364c-4ce8-9a59-e1f722cef8fd" returned: 0 in 0.985s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-73a9505d-a120-4b1f-bec8-ca15b39c7e09 tempest-CreateVolumesFromSnapshotTest-899706040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bc5357b5-364c-4ce8-9a59-e1f722cef8fd {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:46 devstack sudo[93738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bc5357b5-364c-4ce8-9a59-e1f722cef8fd Apr 28 19:26:46 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-21fa9632-7ed7-47cd-84f6-b776f2a2f55d tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:26:46 devstack sudo[93738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:46 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-21fa9632-7ed7-47cd-84f6-b776f2a2f55d tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Flow 'volume_create_manager' (783adbda-d37b-464d-9ad8-141a9f1b947a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:26:46 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-21fa9632-7ed7-47cd-84f6-b776f2a2f55d tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93d644f1-8d00-40db-bfcf-5d128b326172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:46 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-21fa9632-7ed7-47cd-84f6-b776f2a2f55d tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93d644f1-8d00-40db-bfcf-5d128b326172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1185720692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85fc9a94-bec6-4c0f-9819-f7e443ea86fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b5bddd1bcc4323baf898a53931cbe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:26:46Z,use_quota=True,user_id='034e251b5b4a40f49233502eb41915fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:46 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-21fa9632-7ed7-47cd-84f6-b776f2a2f55d tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e6441b1-19e3-45b1-bd45-c2099d6836d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:46 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-21fa9632-7ed7-47cd-84f6-b776f2a2f55d tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e6441b1-19e3-45b1-bd45-c2099d6836d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:46 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-21fa9632-7ed7-47cd-84f6-b776f2a2f55d tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dce8bed9-6b81-4cba-88ed-f199bad47ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:46 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-21fa9632-7ed7-47cd-84f6-b776f2a2f55d tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dce8bed9-6b81-4cba-88ed-f199bad47ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85fc9a94-bec6-4c0f-9819-f7e443ea86fb', 'volume_name': 'volume-85fc9a94-bec6-4c0f-9819-f7e443ea86fb', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:46 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-21fa9632-7ed7-47cd-84f6-b776f2a2f55d tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5c25aac-f1a7-413d-8f88-d8f63f00b113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:46 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-21fa9632-7ed7-47cd-84f6-b776f2a2f55d tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5c25aac-f1a7-413d-8f88-d8f63f00b113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:46 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-21fa9632-7ed7-47cd-84f6-b776f2a2f55d tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59b6e70b-448e-431f-b390-eed688a9eb85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:46 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-21fa9632-7ed7-47cd-84f6-b776f2a2f55d tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Volume 85fc9a94-bec6-4c0f-9819-f7e443ea86fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85fc9a94-bec6-4c0f-9819-f7e443ea86fb', 'volume_size': 1} Apr 28 19:26:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-21fa9632-7ed7-47cd-84f6-b776f2a2f55d tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:46 devstack sudo[93723]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7aaf1b08-23b1-4af7-a969-2037780ecfa1 tempest-SnapshotDependencyTests-840224214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb.9d170213-559b-48bd-82b3-269609d2373d 1G" returned: 0 in 1.174s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7aaf1b08-23b1-4af7-a969-2037780ecfa1 tempest-SnapshotDependencyTests-840224214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10db6bdd-2497-44a9-8434-15c06d8d00eb -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb.9d170213-559b-48bd-82b3-269609d2373d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:46 devstack sudo[93747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10db6bdd-2497-44a9-8434-15c06d8d00eb -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb.9d170213-559b-48bd-82b3-269609d2373d Apr 28 19:26:46 devstack sudo[93747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:46 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5de6700-5a12-4ce6-9ee8-d07ea1143446 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:26:46 devstack sudo[93730]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:46 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5de6700-5a12-4ce6-9ee8-d07ea1143446 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Flow 'volume_create_manager' (2bc0a3f4-9971-47a0-af0a-15651963fa41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:26:46 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5de6700-5a12-4ce6-9ee8-d07ea1143446 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c539f9a-390e-4e35-bd72-1f50896854b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e98b7940-137d-4b77-a106-9704e1e8268e tempest-VolumeDependencyTests-637805770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45.45ed5f04-b689-4b24-8f9c-ec22ee4ac585" returned: 0 in 1.161s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:46 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5de6700-5a12-4ce6-9ee8-d07ea1143446 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c539f9a-390e-4e35-bd72-1f50896854b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-509788676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c14c9fd-5476-411a-aa60-08617b7e1f2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b5bddd1bcc4323baf898a53931cbe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:26:47Z,use_quota=True,user_id='034e251b5b4a40f49233502eb41915fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:46 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5de6700-5a12-4ce6-9ee8-d07ea1143446 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20818905-a247-4d3f-8148-724eb782cdf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:46 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5de6700-5a12-4ce6-9ee8-d07ea1143446 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20818905-a247-4d3f-8148-724eb782cdf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:46 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5de6700-5a12-4ce6-9ee8-d07ea1143446 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cb1ff54-f7a3-4898-aafb-d547e1100c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:46 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5de6700-5a12-4ce6-9ee8-d07ea1143446 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cb1ff54-f7a3-4898-aafb-d547e1100c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c14c9fd-5476-411a-aa60-08617b7e1f2f', 'volume_name': 'volume-3c14c9fd-5476-411a-aa60-08617b7e1f2f', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:46 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5de6700-5a12-4ce6-9ee8-d07ea1143446 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62755ca6-131b-4ad3-9ee8-c6496e5a3ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:46 devstack sudo[93738]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:46 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5de6700-5a12-4ce6-9ee8-d07ea1143446 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62755ca6-131b-4ad3-9ee8-c6496e5a3ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:46 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5de6700-5a12-4ce6-9ee8-d07ea1143446 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48f76342-f9aa-4352-a740-3d9ed2ec90c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:46 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-a5de6700-5a12-4ce6-9ee8-d07ea1143446 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Volume 3c14c9fd-5476-411a-aa60-08617b7e1f2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c14c9fd-5476-411a-aa60-08617b7e1f2f', 'volume_size': 1} Apr 28 19:26:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a5de6700-5a12-4ce6-9ee8-d07ea1143446 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-73a9505d-a120-4b1f-bec8-ca15b39c7e09 tempest-CreateVolumesFromSnapshotTest-899706040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bc5357b5-364c-4ce8-9a59-e1f722cef8fd" returned: 0 in 0.733s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:46 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e98b7940-137d-4b77-a106-9704e1e8268e tempest-VolumeDependencyTests-637805770 None] Lock "cinder-quobyte-45ed5f04-b689-4b24-8f9c-ec22ee4ac585" released by "_delete_snapshot" :: held 4.008s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:26:46 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-73a9505d-a120-4b1f-bec8-ca15b39c7e09 tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "cinder-quobyte-bc5357b5-364c-4ce8-9a59-e1f722cef8fd" released by "delete_volume" :: held 1.794s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:26:46 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e98b7940-137d-4b77-a106-9704e1e8268e tempest-VolumeDependencyTests-637805770 None] Lock "cinder-quobyte-e72a8fc1-2ab4-4355-8247-f42ab18d2f45" released by "delete_snapshot" :: held 4.035s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:26:47 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-73a9505d-a120-4b1f-bec8-ca15b39c7e09 tempest-CreateVolumesFromSnapshotTest-899706040 None] Created reservations ['f7489ab7-a708-486a-8915-13f372f8b0cf', '3088850f-21d3-4f77-b164-c3e1774c445b', '92874776-3fb6-4329-8c42-29f40b27cb87', 'ecccb7c3-30ea-48a2-aee9-67b8a8b2ad36'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:26:47 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-e98b7940-137d-4b77-a106-9704e1e8268e tempest-VolumeDependencyTests-637805770 None] Created reservations ['320dbeb0-b690-43a2-b975-3a6ce62c15f9', 'eaeb7282-66a1-4793-8c8c-79bddad0f52c', '83f195bb-6b7c-457b-8076-6ea1af46a56e', '4ad86978-c81b-428f-b357-a398f35bb91b'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:26:47 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dabe6c8-95d5-4a5a-b715-39f266a82e1c tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:26:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1dabe6c8-95d5-4a5a-b715-39f266a82e1c tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Flow 'volume_create_manager' (43508cce-ee6d-43a2-be33-2f8e48f3b73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:26:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1dabe6c8-95d5-4a5a-b715-39f266a82e1c tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1839e6be-3b8c-46c1-b1af-380fbe95c741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-73a9505d-a120-4b1f-bec8-ca15b39c7e09 tempest-CreateVolumesFromSnapshotTest-899706040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-73a9505d-a120-4b1f-bec8-ca15b39c7e09 tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:47 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-73a9505d-a120-4b1f-bec8-ca15b39c7e09 tempest-CreateVolumesFromSnapshotTest-899706040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:26:47 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-73a9505d-a120-4b1f-bec8-ca15b39c7e09 tempest-CreateVolumesFromSnapshotTest-899706040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:26:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-73a9505d-a120-4b1f-bec8-ca15b39c7e09 tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-73a9505d-a120-4b1f-bec8-ca15b39c7e09 tempest-CreateVolumesFromSnapshotTest-899706040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1dabe6c8-95d5-4a5a-b715-39f266a82e1c tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1839e6be-3b8c-46c1-b1af-380fbe95c741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-200886700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a0cacae-b2d0-4389-a7d7-5a9cc5190149,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b5bddd1bcc4323baf898a53931cbe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:26:47Z,use_quota=True,user_id='034e251b5b4a40f49233502eb41915fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1dabe6c8-95d5-4a5a-b715-39f266a82e1c tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b1f2909-f07d-499f-bc29-e58b80d95341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:47 devstack sudo[93755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:26:47 devstack sudo[93747]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1dabe6c8-95d5-4a5a-b715-39f266a82e1c tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b1f2909-f07d-499f-bc29-e58b80d95341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:47 devstack sudo[93755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1dabe6c8-95d5-4a5a-b715-39f266a82e1c tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32c8cb19-1ad8-4e8c-b5e7-06d2d1bb8e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1dabe6c8-95d5-4a5a-b715-39f266a82e1c tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32c8cb19-1ad8-4e8c-b5e7-06d2d1bb8e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a0cacae-b2d0-4389-a7d7-5a9cc5190149', 'volume_name': 'volume-8a0cacae-b2d0-4389-a7d7-5a9cc5190149', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1dabe6c8-95d5-4a5a-b715-39f266a82e1c tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6501b64e-d8ec-4ace-af0e-a8603dee6f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1dabe6c8-95d5-4a5a-b715-39f266a82e1c tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6501b64e-d8ec-4ace-af0e-a8603dee6f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1dabe6c8-95d5-4a5a-b715-39f266a82e1c tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67c4e4ed-c6ae-42e7-aec2-99952e6a3f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:47 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-1dabe6c8-95d5-4a5a-b715-39f266a82e1c tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Volume 8a0cacae-b2d0-4389-a7d7-5a9cc5190149: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a0cacae-b2d0-4389-a7d7-5a9cc5190149', 'volume_size': 1} Apr 28 19:26:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1dabe6c8-95d5-4a5a-b715-39f266a82e1c tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c24c0131-41ee-4ea1-b05f-883f0a84dbb1 tempest-VolumeDependencyTests-637805770 None] Acquiring lock "cinder-e72a8fc1-2ab4-4355-8247-f42ab18d2f45-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:26:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7aaf1b08-23b1-4af7-a969-2037780ecfa1 tempest-SnapshotDependencyTests-840224214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10db6bdd-2497-44a9-8434-15c06d8d00eb -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb.9d170213-559b-48bd-82b3-269609d2373d" returned: 0 in 0.863s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:47 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-7aaf1b08-23b1-4af7-a969-2037780ecfa1 tempest-SnapshotDependencyTests-840224214 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb.9d170213-559b-48bd-82b3-269609d2373d is being set with open permissions: ugo+rw Apr 28 19:26:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7aaf1b08-23b1-4af7-a969-2037780ecfa1 tempest-SnapshotDependencyTests-840224214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb.9d170213-559b-48bd-82b3-269609d2373d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c24c0131-41ee-4ea1-b05f-883f0a84dbb1 tempest-VolumeDependencyTests-637805770 None] Lock "cinder-e72a8fc1-2ab4-4355-8247-f42ab18d2f45-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:26:47 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-e98b7940-137d-4b77-a106-9704e1e8268e tempest-VolumeDependencyTests-637805770 None] Delete snapshot completed successfully. Apr 28 19:26:47 devstack sudo[93757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb.9d170213-559b-48bd-82b3-269609d2373d Apr 28 19:26:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e98b7940-137d-4b77-a106-9704e1e8268e tempest-VolumeDependencyTests-637805770 None] Lock "cinder-45ed5f04-b689-4b24-8f9c-ec22ee4ac585-delete_snapshot" released by "delete_snapshot" :: held 4.465s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:26:47 devstack sudo[93757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c80cee45-e2a6-4664-8d18-97f39679445d tempest-CreateVolumesFromSnapshotTest-899706040 None] Acquiring lock "cinder-4f2934be-12e7-460b-afe3-dd9707109123-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:26:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c24c0131-41ee-4ea1-b05f-883f0a84dbb1 tempest-VolumeDependencyTests-637805770 None] Acquiring lock "cinder-quobyte-e72a8fc1-2ab4-4355-8247-f42ab18d2f45" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:26:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c80cee45-e2a6-4664-8d18-97f39679445d tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "cinder-4f2934be-12e7-460b-afe3-dd9707109123-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:26:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c80cee45-e2a6-4664-8d18-97f39679445d tempest-CreateVolumesFromSnapshotTest-899706040 None] Acquiring lock "cinder-quobyte-55e921c8-a5a8-4714-ba18-2d0439daf197" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:26:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c24c0131-41ee-4ea1-b05f-883f0a84dbb1 tempest-VolumeDependencyTests-637805770 None] Lock "cinder-quobyte-e72a8fc1-2ab4-4355-8247-f42ab18d2f45" acquired by "delete_volume" :: waited 0.030s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:26:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c80cee45-e2a6-4664-8d18-97f39679445d tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "cinder-quobyte-55e921c8-a5a8-4714-ba18-2d0439daf197" acquired by "delete_snapshot" :: waited 0.053s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:26:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c80cee45-e2a6-4664-8d18-97f39679445d tempest-CreateVolumesFromSnapshotTest-899706040 None] Acquiring lock "cinder-quobyte-4f2934be-12e7-460b-afe3-dd9707109123" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:26:47 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[17926dfe-2ac2-49a9-9cbb-6fc7164ff329]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:26:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c24c0131-41ee-4ea1-b05f-883f0a84dbb1 tempest-VolumeDependencyTests-637805770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c80cee45-e2a6-4664-8d18-97f39679445d tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "cinder-quobyte-4f2934be-12e7-460b-afe3-dd9707109123" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:26:47 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-c80cee45-e2a6-4664-8d18-97f39679445d tempest-CreateVolumesFromSnapshotTest-899706040 None] Deleting offline snapshot 4f2934be-12e7-460b-afe3-dd9707109123 of volume 55e921c8-a5a8-4714-ba18-2d0439daf197 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 19:26:47 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-c80cee45-e2a6-4664-8d18-97f39679445d tempest-CreateVolumesFromSnapshotTest-899706040 None] snapshot_file for this snap is: volume-55e921c8-a5a8-4714-ba18-2d0439daf197.4f2934be-12e7-460b-afe3-dd9707109123 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 19:26:47 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9b0f7f-11cc-4820-a381-f09a3668c515]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:26:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c80cee45-e2a6-4664-8d18-97f39679445d tempest-CreateVolumesFromSnapshotTest-899706040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55e921c8-a5a8-4714-ba18-2d0439daf197.4f2934be-12e7-460b-afe3-dd9707109123 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:47 devstack sudo[93759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45 Apr 28 19:26:47 devstack sudo[93759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:47 devstack sudo[93760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55e921c8-a5a8-4714-ba18-2d0439daf197.4f2934be-12e7-460b-afe3-dd9707109123 Apr 28 19:26:47 devstack sudo[93760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:47 devstack sudo[93755]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-73a9505d-a120-4b1f-bec8-ca15b39c7e09 tempest-CreateVolumesFromSnapshotTest-899706040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.695s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:47 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-73a9505d-a120-4b1f-bec8-ca15b39c7e09 tempest-CreateVolumesFromSnapshotTest-899706040 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:26:47 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-73a9505d-a120-4b1f-bec8-ca15b39c7e09 tempest-CreateVolumesFromSnapshotTest-899706040 None] Deleted volume successfully. Apr 28 19:26:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-73a9505d-a120-4b1f-bec8-ca15b39c7e09 tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "cinder-bc5357b5-364c-4ce8-9a59-e1f722cef8fd-delete_volume" released by "delete_volume" :: held 2.901s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:26:48 devstack sudo[93757]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7aaf1b08-23b1-4af7-a969-2037780ecfa1 tempest-SnapshotDependencyTests-840224214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb.9d170213-559b-48bd-82b3-269609d2373d" returned: 0 in 0.730s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7aaf1b08-23b1-4af7-a969-2037780ecfa1 tempest-SnapshotDependencyTests-840224214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:48 devstack sudo[93765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb.info Apr 28 19:26:48 devstack sudo[93765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:48 devstack sudo[93759]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c24c0131-41ee-4ea1-b05f-883f0a84dbb1 tempest-VolumeDependencyTests-637805770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45" returned: 0 in 0.832s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c24c0131-41ee-4ea1-b05f-883f0a84dbb1 tempest-VolumeDependencyTests-637805770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:48 devstack sudo[93760]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c80cee45-e2a6-4664-8d18-97f39679445d tempest-CreateVolumesFromSnapshotTest-899706040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55e921c8-a5a8-4714-ba18-2d0439daf197.4f2934be-12e7-460b-afe3-dd9707109123" returned: 0 in 0.778s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:48 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-c80cee45-e2a6-4664-8d18-97f39679445d tempest-CreateVolumesFromSnapshotTest-899706040 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55e921c8-a5a8-4714-ba18-2d0439daf197(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:26:48 devstack sudo[93775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45 Apr 28 19:26:48 devstack sudo[93775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:48 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8986c5c0-8297-4485-b459-3af7adca6a55]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:26:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c80cee45-e2a6-4664-8d18-97f39679445d tempest-CreateVolumesFromSnapshotTest-899706040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55e921c8-a5a8-4714-ba18-2d0439daf197 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:48 devstack sudo[93777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55e921c8-a5a8-4714-ba18-2d0439daf197 Apr 28 19:26:48 devstack sudo[93777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:48 devstack sudo[93765]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7aaf1b08-23b1-4af7-a969-2037780ecfa1 tempest-SnapshotDependencyTests-840224214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb.info" returned: 0 in 0.651s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:48 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-7aaf1b08-23b1-4af7-a969-2037780ecfa1 tempest-SnapshotDependencyTests-840224214 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb.info is being set with open permissions: ugo+rw Apr 28 19:26:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7aaf1b08-23b1-4af7-a969-2037780ecfa1 tempest-SnapshotDependencyTests-840224214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:48 devstack sudo[93780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb.info Apr 28 19:26:48 devstack sudo[93780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:49 devstack sudo[93775]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c24c0131-41ee-4ea1-b05f-883f0a84dbb1 tempest-VolumeDependencyTests-637805770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e72a8fc1-2ab4-4355-8247-f42ab18d2f45" returned: 0 in 0.697s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:49 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c24c0131-41ee-4ea1-b05f-883f0a84dbb1 tempest-VolumeDependencyTests-637805770 None] Lock "cinder-quobyte-e72a8fc1-2ab4-4355-8247-f42ab18d2f45" released by "delete_volume" :: held 1.606s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:26:49 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-c24c0131-41ee-4ea1-b05f-883f0a84dbb1 tempest-VolumeDependencyTests-637805770 None] Created reservations ['9c6281f9-b34a-448a-a3d5-cd1104b8216b', '06b1a221-02e8-4e34-b2bd-c7a02beee84f', 'd8be72bb-6f59-434d-ad1a-c1a81dec5444', '356a17f8-efcf-4dc9-8605-0211ed1a57ed'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:26:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c24c0131-41ee-4ea1-b05f-883f0a84dbb1 tempest-VolumeDependencyTests-637805770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c24c0131-41ee-4ea1-b05f-883f0a84dbb1 tempest-VolumeDependencyTests-637805770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:49 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c24c0131-41ee-4ea1-b05f-883f0a84dbb1 tempest-VolumeDependencyTests-637805770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:26:49 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c24c0131-41ee-4ea1-b05f-883f0a84dbb1 tempest-VolumeDependencyTests-637805770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:26:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c24c0131-41ee-4ea1-b05f-883f0a84dbb1 tempest-VolumeDependencyTests-637805770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c24c0131-41ee-4ea1-b05f-883f0a84dbb1 tempest-VolumeDependencyTests-637805770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:49 devstack sudo[93777]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c80cee45-e2a6-4664-8d18-97f39679445d tempest-CreateVolumesFromSnapshotTest-899706040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55e921c8-a5a8-4714-ba18-2d0439daf197" returned: 0 in 0.800s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c80cee45-e2a6-4664-8d18-97f39679445d tempest-CreateVolumesFromSnapshotTest-899706040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55e921c8-a5a8-4714-ba18-2d0439daf197.4f2934be-12e7-460b-afe3-dd9707109123 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:49 devstack sudo[93786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:26:49 devstack sudo[93786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:49 devstack sudo[93787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55e921c8-a5a8-4714-ba18-2d0439daf197.4f2934be-12e7-460b-afe3-dd9707109123 Apr 28 19:26:49 devstack sudo[93787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:49 devstack sudo[93780]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7aaf1b08-23b1-4af7-a969-2037780ecfa1 tempest-SnapshotDependencyTests-840224214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb.info" returned: 0 in 0.691s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7aaf1b08-23b1-4af7-a969-2037780ecfa1 tempest-SnapshotDependencyTests-840224214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.257s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e26c8fec-9ce7-42bd-989c-2dc6df99627a tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.022s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:49 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-e26c8fec-9ce7-42bd-989c-2dc6df99627a tempest-CreateVolumesFromSourceVolumeTest-978811713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-942536363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7528466-f088-4468-b9ba-dbafe05674d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b5bddd1bcc4323baf898a53931cbe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:26:45Z,use_quota=True,user_id='034e251b5b4a40f49233502eb41915fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:26:49 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-e26c8fec-9ce7-42bd-989c-2dc6df99627a tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Creating volume d7528466-f088-4468-b9ba-dbafe05674d5 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:26:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e26c8fec-9ce7-42bd-989c-2dc6df99627a tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e26c8fec-9ce7-42bd-989c-2dc6df99627a tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:49 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-e26c8fec-9ce7-42bd-989c-2dc6df99627a tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:26:49 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-e26c8fec-9ce7-42bd-989c-2dc6df99627a tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:26:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e26c8fec-9ce7-42bd-989c-2dc6df99627a tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:49 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-e26c8fec-9ce7-42bd-989c-2dc6df99627a tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:26:49 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-e26c8fec-9ce7-42bd-989c-2dc6df99627a tempest-CreateVolumesFromSourceVolumeTest-978811713 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:26:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e26c8fec-9ce7-42bd-989c-2dc6df99627a tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d7528466-f088-4468-b9ba-dbafe05674d5 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:49 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-7aaf1b08-23b1-4af7-a969-2037780ecfa1 tempest-SnapshotDependencyTests-840224214 None] Create snapshot completed successfully Apr 28 19:26:49 devstack sudo[93791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d7528466-f088-4468-b9ba-dbafe05674d5 1073741824 Apr 28 19:26:49 devstack sudo[93791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:49 devstack sudo[93786]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c24c0131-41ee-4ea1-b05f-883f0a84dbb1 tempest-VolumeDependencyTests-637805770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.728s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:49 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-c24c0131-41ee-4ea1-b05f-883f0a84dbb1 tempest-VolumeDependencyTests-637805770 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:26:49 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-c24c0131-41ee-4ea1-b05f-883f0a84dbb1 tempest-VolumeDependencyTests-637805770 None] Deleted volume successfully. Apr 28 19:26:49 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c24c0131-41ee-4ea1-b05f-883f0a84dbb1 tempest-VolumeDependencyTests-637805770 None] Lock "cinder-e72a8fc1-2ab4-4355-8247-f42ab18d2f45-delete_volume" released by "delete_volume" :: held 2.595s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:26:49 devstack sudo[93787]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c80cee45-e2a6-4664-8d18-97f39679445d tempest-CreateVolumesFromSnapshotTest-899706040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55e921c8-a5a8-4714-ba18-2d0439daf197.4f2934be-12e7-460b-afe3-dd9707109123" returned: 0 in 0.780s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c80cee45-e2a6-4664-8d18-97f39679445d tempest-CreateVolumesFromSnapshotTest-899706040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55e921c8-a5a8-4714-ba18-2d0439daf197.4f2934be-12e7-460b-afe3-dd9707109123 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:50 devstack sudo[93798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55e921c8-a5a8-4714-ba18-2d0439daf197.4f2934be-12e7-460b-afe3-dd9707109123 Apr 28 19:26:50 devstack sudo[93798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:50 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-0db7101f-d106-4f08-a9fb-8b6f11767fac tempest-VolumeDependencyTests-637805770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:26:50 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0db7101f-d106-4f08-a9fb-8b6f11767fac tempest-VolumeDependencyTests-637805770 None] Flow 'volume_create_manager' (ebd9b7ff-b753-4c4e-9ddc-7d02d53bbb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:26:50 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0db7101f-d106-4f08-a9fb-8b6f11767fac tempest-VolumeDependencyTests-637805770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2377df8d-80cb-40f2-8de8-bfcff36f1dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:50 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0db7101f-d106-4f08-a9fb-8b6f11767fac tempest-VolumeDependencyTests-637805770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2377df8d-80cb-40f2-8de8-bfcff36f1dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1286974394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4dfb15c-39d3-42b3-a276-9ea429ee10b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dec47550fdfb4870b6e7667d4a4ef673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:26:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:26:50Z,use_quota=True,user_id='4b5be3fcfe14488181e5b7b0cbbb1bde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:50 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0db7101f-d106-4f08-a9fb-8b6f11767fac tempest-VolumeDependencyTests-637805770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3feeec8b-a983-411b-ab33-49266693f3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:50 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0db7101f-d106-4f08-a9fb-8b6f11767fac tempest-VolumeDependencyTests-637805770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3feeec8b-a983-411b-ab33-49266693f3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:50 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0db7101f-d106-4f08-a9fb-8b6f11767fac tempest-VolumeDependencyTests-637805770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b2ce6b6-8fb7-451a-b750-a2e0852aee7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:50 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0db7101f-d106-4f08-a9fb-8b6f11767fac tempest-VolumeDependencyTests-637805770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b2ce6b6-8fb7-451a-b750-a2e0852aee7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4dfb15c-39d3-42b3-a276-9ea429ee10b3', 'volume_name': 'volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:50 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0db7101f-d106-4f08-a9fb-8b6f11767fac tempest-VolumeDependencyTests-637805770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1d9c46c-085a-49ba-af69-dac297bbaf39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:50 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0db7101f-d106-4f08-a9fb-8b6f11767fac tempest-VolumeDependencyTests-637805770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1d9c46c-085a-49ba-af69-dac297bbaf39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:50 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0db7101f-d106-4f08-a9fb-8b6f11767fac tempest-VolumeDependencyTests-637805770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c15dcaec-b72a-4e85-9d16-9b5e4f34fdba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:50 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-0db7101f-d106-4f08-a9fb-8b6f11767fac tempest-VolumeDependencyTests-637805770 None] Volume e4dfb15c-39d3-42b3-a276-9ea429ee10b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3', 'volume_size': 1} Apr 28 19:26:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0db7101f-d106-4f08-a9fb-8b6f11767fac tempest-VolumeDependencyTests-637805770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:50 devstack sudo[93791]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e26c8fec-9ce7-42bd-989c-2dc6df99627a tempest-CreateVolumesFromSourceVolumeTest-978811713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d7528466-f088-4468-b9ba-dbafe05674d5 1073741824" returned: 0 in 0.938s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e26c8fec-9ce7-42bd-989c-2dc6df99627a tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d7528466-f088-4468-b9ba-dbafe05674d5 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:50 devstack sudo[93803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d7528466-f088-4468-b9ba-dbafe05674d5 Apr 28 19:26:50 devstack sudo[93803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:50 devstack sudo[93798]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c80cee45-e2a6-4664-8d18-97f39679445d tempest-CreateVolumesFromSnapshotTest-899706040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55e921c8-a5a8-4714-ba18-2d0439daf197.4f2934be-12e7-460b-afe3-dd9707109123" returned: 0 in 0.626s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:50 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c80cee45-e2a6-4664-8d18-97f39679445d tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "cinder-quobyte-4f2934be-12e7-460b-afe3-dd9707109123" released by "_delete_snapshot" :: held 3.127s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:26:50 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c80cee45-e2a6-4664-8d18-97f39679445d tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "cinder-quobyte-55e921c8-a5a8-4714-ba18-2d0439daf197" released by "delete_snapshot" :: held 3.169s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:26:50 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-c80cee45-e2a6-4664-8d18-97f39679445d tempest-CreateVolumesFromSnapshotTest-899706040 None] Created reservations ['b95a00cd-6ac3-48b2-88c0-87059f5da517', '60eb2d19-cc5a-4f22-8d91-da4997a176c4', '49573316-4cfa-48af-b619-893dec9d05d4', '99a5787d-570d-494c-9c48-c9cc8a3110f3'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:26:50 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-c80cee45-e2a6-4664-8d18-97f39679445d tempest-CreateVolumesFromSnapshotTest-899706040 None] Delete snapshot completed successfully. Apr 28 19:26:50 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c80cee45-e2a6-4664-8d18-97f39679445d tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "cinder-4f2934be-12e7-460b-afe3-dd9707109123-delete_snapshot" released by "delete_snapshot" :: held 3.348s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:26:51 devstack sudo[93803]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e26c8fec-9ce7-42bd-989c-2dc6df99627a tempest-CreateVolumesFromSourceVolumeTest-978811713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d7528466-f088-4468-b9ba-dbafe05674d5" returned: 0 in 0.635s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:51 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-e26c8fec-9ce7-42bd-989c-2dc6df99627a tempest-CreateVolumesFromSourceVolumeTest-978811713 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:26:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e26c8fec-9ce7-42bd-989c-2dc6df99627a tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0853f3a1-d72b-410d-aa33-d68780431ffa tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.197s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:51 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0853f3a1-d72b-410d-aa33-d68780431ffa tempest-CreateVolumesFromSourceVolumeTest-978811713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-632799271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2b76522-a286-4f90-adf8-43101cfd64b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b5bddd1bcc4323baf898a53931cbe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:26:46Z,use_quota=True,user_id='034e251b5b4a40f49233502eb41915fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:26:51 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-0853f3a1-d72b-410d-aa33-d68780431ffa tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Creating volume f2b76522-a286-4f90-adf8-43101cfd64b1 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:26:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0853f3a1-d72b-410d-aa33-d68780431ffa tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0853f3a1-d72b-410d-aa33-d68780431ffa tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:51 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0853f3a1-d72b-410d-aa33-d68780431ffa tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:26:51 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0853f3a1-d72b-410d-aa33-d68780431ffa tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:26:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0853f3a1-d72b-410d-aa33-d68780431ffa tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:51 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0853f3a1-d72b-410d-aa33-d68780431ffa tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:26:51 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-0853f3a1-d72b-410d-aa33-d68780431ffa tempest-CreateVolumesFromSourceVolumeTest-978811713 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:26:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0853f3a1-d72b-410d-aa33-d68780431ffa tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f2b76522-a286-4f90-adf8-43101cfd64b1 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:51 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:26:51 devstack sudo[93810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f2b76522-a286-4f90-adf8-43101cfd64b1 1073741824 Apr 28 19:26:51 devstack sudo[93810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e26c8fec-9ce7-42bd-989c-2dc6df99627a tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baef5fa8-2889-4237-b72e-0da579c50546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7528466-f088-4468-b9ba-dbafe05674d5', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e26c8fec-9ce7-42bd-989c-2dc6df99627a tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f58ef9b5-088d-490b-8b7f-1c1db83cf8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] Flow 'volume_create_manager' (05542c4a-6734-41bb-8d93-a0a71ec6d8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:26:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e5fee98-0c7a-4e43-af04-3b65a8b2c9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:51 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-e26c8fec-9ce7-42bd-989c-2dc6df99627a tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Volume volume-d7528466-f088-4468-b9ba-dbafe05674d5 (d7528466-f088-4468-b9ba-dbafe05674d5): created successfully Apr 28 19:26:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e26c8fec-9ce7-42bd-989c-2dc6df99627a tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f58ef9b5-088d-490b-8b7f-1c1db83cf8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-e26c8fec-9ce7-42bd-989c-2dc6df99627a tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Flow 'volume_create_manager' (95863ad0-64c0-4418-9b59-7beff23fa24f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:26:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e5fee98-0c7a-4e43-af04-3b65a8b2c9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9287d5c-9f40-439e-a9d5-7455d7561c53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94aade7cbe8549f2a36923e04b232ad0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9d170213-559b-48bd-82b3-269609d2373d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:26:51Z,use_quota=True,user_id='3246233ee2dd480b8a54a4267f9c4538',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b7e4510-bdc6-477f-9469-7b72ef9bcc60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b7e4510-bdc6-477f-9469-7b72ef9bcc60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d5ce689-3437-4918-931f-c1b160032db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d5ce689-3437-4918-931f-c1b160032db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c9287d5c-9f40-439e-a9d5-7455d7561c53', 'volume_name': 'volume-c9287d5c-9f40-439e-a9d5-7455d7561c53', 'volume_size': 1, 'snapshot_id': '9d170213-559b-48bd-82b3-269609d2373d'}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (850c452e-74a4-444b-833e-8a850f21af14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (850c452e-74a4-444b-833e-8a850f21af14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beff24c3-cca0-44c1-aa50-2e83768548c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:51 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] Volume c9287d5c-9f40-439e-a9d5-7455d7561c53: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c9287d5c-9f40-439e-a9d5-7455d7561c53', 'volume_size': 1, 'snapshot_id': '9d170213-559b-48bd-82b3-269609d2373d'} Apr 28 19:26:51 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-e26c8fec-9ce7-42bd-989c-2dc6df99627a tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Created volume successfully. Apr 28 19:26:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:51 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8eda1623-679d-4ba3-9bd7-e6c489be4800 tempest-CreateVolumesFromSnapshotTest-899706040 None] Acquiring lock "cinder-55e921c8-a5a8-4714-ba18-2d0439daf197-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:26:51 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8eda1623-679d-4ba3-9bd7-e6c489be4800 tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "cinder-55e921c8-a5a8-4714-ba18-2d0439daf197-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:26:51 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8eda1623-679d-4ba3-9bd7-e6c489be4800 tempest-CreateVolumesFromSnapshotTest-899706040 None] Acquiring lock "cinder-quobyte-55e921c8-a5a8-4714-ba18-2d0439daf197" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:26:51 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8eda1623-679d-4ba3-9bd7-e6c489be4800 tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "cinder-quobyte-55e921c8-a5a8-4714-ba18-2d0439daf197" acquired by "delete_volume" :: waited 0.016s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:26:51 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d1a2d1-c09c-4c2b-996c-3b0aa5ca2084]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:26:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8eda1623-679d-4ba3-9bd7-e6c489be4800 tempest-CreateVolumesFromSnapshotTest-899706040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55e921c8-a5a8-4714-ba18-2d0439daf197 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:51 devstack sudo[93815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55e921c8-a5a8-4714-ba18-2d0439daf197 Apr 28 19:26:51 devstack sudo[93815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:51 devstack sudo[93810]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0853f3a1-d72b-410d-aa33-d68780431ffa tempest-CreateVolumesFromSourceVolumeTest-978811713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f2b76522-a286-4f90-adf8-43101cfd64b1 1073741824" returned: 0 in 0.827s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0853f3a1-d72b-410d-aa33-d68780431ffa tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f2b76522-a286-4f90-adf8-43101cfd64b1 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:52 devstack sudo[93817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f2b76522-a286-4f90-adf8-43101cfd64b1 Apr 28 19:26:52 devstack sudo[93817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:52 devstack sudo[93815]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8eda1623-679d-4ba3-9bd7-e6c489be4800 tempest-CreateVolumesFromSnapshotTest-899706040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55e921c8-a5a8-4714-ba18-2d0439daf197" returned: 0 in 0.726s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8eda1623-679d-4ba3-9bd7-e6c489be4800 tempest-CreateVolumesFromSnapshotTest-899706040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55e921c8-a5a8-4714-ba18-2d0439daf197 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:52 devstack sudo[93823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55e921c8-a5a8-4714-ba18-2d0439daf197 Apr 28 19:26:52 devstack sudo[93823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:52 devstack sudo[93817]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0853f3a1-d72b-410d-aa33-d68780431ffa tempest-CreateVolumesFromSourceVolumeTest-978811713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f2b76522-a286-4f90-adf8-43101cfd64b1" returned: 0 in 0.623s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:52 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0853f3a1-d72b-410d-aa33-d68780431ffa tempest-CreateVolumesFromSourceVolumeTest-978811713 None] <== create_volume: return (1489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:26:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0853f3a1-d72b-410d-aa33-d68780431ffa tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.492s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-21fa9632-7ed7-47cd-84f6-b776f2a2f55d tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.278s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:52 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-21fa9632-7ed7-47cd-84f6-b776f2a2f55d tempest-CreateVolumesFromSourceVolumeTest-978811713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1185720692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85fc9a94-bec6-4c0f-9819-f7e443ea86fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b5bddd1bcc4323baf898a53931cbe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:26:46Z,use_quota=True,user_id='034e251b5b4a40f49233502eb41915fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:26:52 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-21fa9632-7ed7-47cd-84f6-b776f2a2f55d tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Creating volume 85fc9a94-bec6-4c0f-9819-f7e443ea86fb {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:26:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-21fa9632-7ed7-47cd-84f6-b776f2a2f55d tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-21fa9632-7ed7-47cd-84f6-b776f2a2f55d tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:52 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-21fa9632-7ed7-47cd-84f6-b776f2a2f55d tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:26:52 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-21fa9632-7ed7-47cd-84f6-b776f2a2f55d tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:26:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-21fa9632-7ed7-47cd-84f6-b776f2a2f55d tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:52 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-21fa9632-7ed7-47cd-84f6-b776f2a2f55d tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:26:52 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-21fa9632-7ed7-47cd-84f6-b776f2a2f55d tempest-CreateVolumesFromSourceVolumeTest-978811713 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:26:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-21fa9632-7ed7-47cd-84f6-b776f2a2f55d tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-85fc9a94-bec6-4c0f-9819-f7e443ea86fb 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:52 devstack sudo[93825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-85fc9a94-bec6-4c0f-9819-f7e443ea86fb 1073741824 Apr 28 19:26:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0853f3a1-d72b-410d-aa33-d68780431ffa tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3498477e-b269-4bfb-8c0c-0eaa423bd63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2b76522-a286-4f90-adf8-43101cfd64b1', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:52 devstack sudo[93825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0853f3a1-d72b-410d-aa33-d68780431ffa tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (731d3647-e42a-4072-ad23-5bef83917f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:52 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-0853f3a1-d72b-410d-aa33-d68780431ffa tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Volume volume-f2b76522-a286-4f90-adf8-43101cfd64b1 (f2b76522-a286-4f90-adf8-43101cfd64b1): created successfully Apr 28 19:26:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0853f3a1-d72b-410d-aa33-d68780431ffa tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (731d3647-e42a-4072-ad23-5bef83917f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0853f3a1-d72b-410d-aa33-d68780431ffa tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Flow 'volume_create_manager' (b4b0407d-926a-4858-8127-5c1eb84ad263) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:26:52 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-0853f3a1-d72b-410d-aa33-d68780431ffa tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Created volume successfully. Apr 28 19:26:53 devstack sudo[93823]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8eda1623-679d-4ba3-9bd7-e6c489be4800 tempest-CreateVolumesFromSnapshotTest-899706040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-55e921c8-a5a8-4714-ba18-2d0439daf197" returned: 0 in 0.600s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:53 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8eda1623-679d-4ba3-9bd7-e6c489be4800 tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "cinder-quobyte-55e921c8-a5a8-4714-ba18-2d0439daf197" released by "delete_volume" :: held 1.401s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:26:53 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-8eda1623-679d-4ba3-9bd7-e6c489be4800 tempest-CreateVolumesFromSnapshotTest-899706040 None] Created reservations ['bd7d1104-4b04-4ecb-8e1e-5ac126181d09', '615c0cce-5bb8-42e7-9fa7-052a32a64136', 'edc1d5c8-591c-4ab8-b567-ff7034b85eb2', '226bc033-fbc0-4aca-b6c3-8bef27de646c'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:26:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8eda1623-679d-4ba3-9bd7-e6c489be4800 tempest-CreateVolumesFromSnapshotTest-899706040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8eda1623-679d-4ba3-9bd7-e6c489be4800 tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:53 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-8eda1623-679d-4ba3-9bd7-e6c489be4800 tempest-CreateVolumesFromSnapshotTest-899706040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:26:53 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-8eda1623-679d-4ba3-9bd7-e6c489be4800 tempest-CreateVolumesFromSnapshotTest-899706040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:26:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8eda1623-679d-4ba3-9bd7-e6c489be4800 tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8eda1623-679d-4ba3-9bd7-e6c489be4800 tempest-CreateVolumesFromSnapshotTest-899706040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:53 devstack sudo[93832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:26:53 devstack sudo[93832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:53 devstack sudo[93825]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-21fa9632-7ed7-47cd-84f6-b776f2a2f55d tempest-CreateVolumesFromSourceVolumeTest-978811713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-85fc9a94-bec6-4c0f-9819-f7e443ea86fb 1073741824" returned: 0 in 0.825s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-21fa9632-7ed7-47cd-84f6-b776f2a2f55d tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-85fc9a94-bec6-4c0f-9819-f7e443ea86fb {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:53 devstack sudo[93834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-85fc9a94-bec6-4c0f-9819-f7e443ea86fb Apr 28 19:26:53 devstack sudo[93834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:53 devstack sudo[93832]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8eda1623-679d-4ba3-9bd7-e6c489be4800 tempest-CreateVolumesFromSnapshotTest-899706040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.600s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:53 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-8eda1623-679d-4ba3-9bd7-e6c489be4800 tempest-CreateVolumesFromSnapshotTest-899706040 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:26:53 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-8eda1623-679d-4ba3-9bd7-e6c489be4800 tempest-CreateVolumesFromSnapshotTest-899706040 None] Deleted volume successfully. Apr 28 19:26:53 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8eda1623-679d-4ba3-9bd7-e6c489be4800 tempest-CreateVolumesFromSnapshotTest-899706040 None] Lock "cinder-55e921c8-a5a8-4714-ba18-2d0439daf197-delete_volume" released by "delete_volume" :: held 2.198s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:26:54 devstack sudo[93834]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-21fa9632-7ed7-47cd-84f6-b776f2a2f55d tempest-CreateVolumesFromSourceVolumeTest-978811713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-85fc9a94-bec6-4c0f-9819-f7e443ea86fb" returned: 0 in 0.610s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:54 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-21fa9632-7ed7-47cd-84f6-b776f2a2f55d tempest-CreateVolumesFromSourceVolumeTest-978811713 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:26:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-21fa9632-7ed7-47cd-84f6-b776f2a2f55d tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a5de6700-5a12-4ce6-9ee8-d07ea1143446 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.188s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:54 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a5de6700-5a12-4ce6-9ee8-d07ea1143446 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-509788676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c14c9fd-5476-411a-aa60-08617b7e1f2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b5bddd1bcc4323baf898a53931cbe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:26:47Z,use_quota=True,user_id='034e251b5b4a40f49233502eb41915fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:26:54 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-a5de6700-5a12-4ce6-9ee8-d07ea1143446 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Creating volume 3c14c9fd-5476-411a-aa60-08617b7e1f2f {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:26:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a5de6700-5a12-4ce6-9ee8-d07ea1143446 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a5de6700-5a12-4ce6-9ee8-d07ea1143446 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:54 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a5de6700-5a12-4ce6-9ee8-d07ea1143446 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:26:54 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a5de6700-5a12-4ce6-9ee8-d07ea1143446 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:26:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a5de6700-5a12-4ce6-9ee8-d07ea1143446 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:54 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a5de6700-5a12-4ce6-9ee8-d07ea1143446 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:26:54 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-a5de6700-5a12-4ce6-9ee8-d07ea1143446 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:26:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a5de6700-5a12-4ce6-9ee8-d07ea1143446 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3c14c9fd-5476-411a-aa60-08617b7e1f2f 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:54 devstack sudo[93838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3c14c9fd-5476-411a-aa60-08617b7e1f2f 1073741824 Apr 28 19:26:54 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-21fa9632-7ed7-47cd-84f6-b776f2a2f55d tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59b6e70b-448e-431f-b390-eed688a9eb85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85fc9a94-bec6-4c0f-9819-f7e443ea86fb', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:54 devstack sudo[93838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:54 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-21fa9632-7ed7-47cd-84f6-b776f2a2f55d tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3fe9498-3c9b-4943-9548-6d47353f13cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:54 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-21fa9632-7ed7-47cd-84f6-b776f2a2f55d tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Volume volume-85fc9a94-bec6-4c0f-9819-f7e443ea86fb (85fc9a94-bec6-4c0f-9819-f7e443ea86fb): created successfully Apr 28 19:26:54 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-21fa9632-7ed7-47cd-84f6-b776f2a2f55d tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3fe9498-3c9b-4943-9548-6d47353f13cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:54 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-21fa9632-7ed7-47cd-84f6-b776f2a2f55d tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Flow 'volume_create_manager' (783adbda-d37b-464d-9ad8-141a9f1b947a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:26:54 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-21fa9632-7ed7-47cd-84f6-b776f2a2f55d tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Created volume successfully. Apr 28 19:26:55 devstack sudo[93838]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a5de6700-5a12-4ce6-9ee8-d07ea1143446 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3c14c9fd-5476-411a-aa60-08617b7e1f2f 1073741824" returned: 0 in 0.904s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a5de6700-5a12-4ce6-9ee8-d07ea1143446 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3c14c9fd-5476-411a-aa60-08617b7e1f2f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:55 devstack sudo[93844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3c14c9fd-5476-411a-aa60-08617b7e1f2f Apr 28 19:26:55 devstack sudo[93844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:55 devstack sudo[93844]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a5de6700-5a12-4ce6-9ee8-d07ea1143446 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3c14c9fd-5476-411a-aa60-08617b7e1f2f" returned: 0 in 0.621s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:55 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a5de6700-5a12-4ce6-9ee8-d07ea1143446 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] <== create_volume: return (1570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:26:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a5de6700-5a12-4ce6-9ee8-d07ea1143446 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.574s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1dabe6c8-95d5-4a5a-b715-39f266a82e1c tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.375s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:55 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1dabe6c8-95d5-4a5a-b715-39f266a82e1c tempest-CreateVolumesFromSourceVolumeTest-978811713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-200886700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a0cacae-b2d0-4389-a7d7-5a9cc5190149,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b5bddd1bcc4323baf898a53931cbe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:26:47Z,use_quota=True,user_id='034e251b5b4a40f49233502eb41915fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:26:55 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-1dabe6c8-95d5-4a5a-b715-39f266a82e1c tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Creating volume 8a0cacae-b2d0-4389-a7d7-5a9cc5190149 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:26:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1dabe6c8-95d5-4a5a-b715-39f266a82e1c tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1dabe6c8-95d5-4a5a-b715-39f266a82e1c tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:55 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1dabe6c8-95d5-4a5a-b715-39f266a82e1c tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:26:55 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1dabe6c8-95d5-4a5a-b715-39f266a82e1c tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:26:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1dabe6c8-95d5-4a5a-b715-39f266a82e1c tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:55 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1dabe6c8-95d5-4a5a-b715-39f266a82e1c tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:26:55 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-1dabe6c8-95d5-4a5a-b715-39f266a82e1c tempest-CreateVolumesFromSourceVolumeTest-978811713 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:26:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1dabe6c8-95d5-4a5a-b715-39f266a82e1c tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-8a0cacae-b2d0-4389-a7d7-5a9cc5190149 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:55 devstack sudo[93847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-8a0cacae-b2d0-4389-a7d7-5a9cc5190149 1073741824 Apr 28 19:26:55 devstack sudo[93847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:55 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5de6700-5a12-4ce6-9ee8-d07ea1143446 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48f76342-f9aa-4352-a740-3d9ed2ec90c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c14c9fd-5476-411a-aa60-08617b7e1f2f', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:55 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5de6700-5a12-4ce6-9ee8-d07ea1143446 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a012d71b-4508-4d35-af6a-fc5216b0f7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:55 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-a5de6700-5a12-4ce6-9ee8-d07ea1143446 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Volume volume-3c14c9fd-5476-411a-aa60-08617b7e1f2f (3c14c9fd-5476-411a-aa60-08617b7e1f2f): created successfully Apr 28 19:26:55 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5de6700-5a12-4ce6-9ee8-d07ea1143446 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a012d71b-4508-4d35-af6a-fc5216b0f7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:55 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5de6700-5a12-4ce6-9ee8-d07ea1143446 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Flow 'volume_create_manager' (2bc0a3f4-9971-47a0-af0a-15651963fa41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:26:55 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-a5de6700-5a12-4ce6-9ee8-d07ea1143446 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Created volume successfully. Apr 28 19:26:56 devstack sudo[93847]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1dabe6c8-95d5-4a5a-b715-39f266a82e1c tempest-CreateVolumesFromSourceVolumeTest-978811713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-8a0cacae-b2d0-4389-a7d7-5a9cc5190149 1073741824" returned: 0 in 0.817s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1dabe6c8-95d5-4a5a-b715-39f266a82e1c tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-8a0cacae-b2d0-4389-a7d7-5a9cc5190149 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:56 devstack sudo[93854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-8a0cacae-b2d0-4389-a7d7-5a9cc5190149 Apr 28 19:26:56 devstack sudo[93854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:56 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc9bf55b-d553-41a8-a6d6-8aa01ec8cb75 tempest-CinderUnicodeTest-924680598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:26:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-dc9bf55b-d553-41a8-a6d6-8aa01ec8cb75 tempest-CinderUnicodeTest-924680598 None] Flow 'volume_create_manager' (cbae6f86-9a4c-495e-a987-971d71d09ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:26:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-dc9bf55b-d553-41a8-a6d6-8aa01ec8cb75 tempest-CinderUnicodeTest-924680598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1f76deb-f78d-4e55-bb6c-ef6d6f8f468d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-dc9bf55b-d553-41a8-a6d6-8aa01ec8cb75 tempest-CinderUnicodeTest-924680598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1f76deb-f78d-4e55-bb6c-ef6d6f8f468d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:26:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf992e0e-660f-45f8-b23f-0fee1a2a2641,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96578aae93ba4e759f9effaa51d814c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:26:57Z,use_quota=True,user_id='89b195fb07a844d08823ff41392be76c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-dc9bf55b-d553-41a8-a6d6-8aa01ec8cb75 tempest-CinderUnicodeTest-924680598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1668024b-614f-4864-8cb8-ccf8425952ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-dc9bf55b-d553-41a8-a6d6-8aa01ec8cb75 tempest-CinderUnicodeTest-924680598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1668024b-614f-4864-8cb8-ccf8425952ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-dc9bf55b-d553-41a8-a6d6-8aa01ec8cb75 tempest-CinderUnicodeTest-924680598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e31447db-bd1e-423b-8291-f2afe0dd5688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-dc9bf55b-d553-41a8-a6d6-8aa01ec8cb75 tempest-CinderUnicodeTest-924680598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e31447db-bd1e-423b-8291-f2afe0dd5688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf992e0e-660f-45f8-b23f-0fee1a2a2641', 'volume_name': 'volume-bf992e0e-660f-45f8-b23f-0fee1a2a2641', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-dc9bf55b-d553-41a8-a6d6-8aa01ec8cb75 tempest-CinderUnicodeTest-924680598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc8d3009-ecd9-4532-896d-3b5fdb29746c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-dc9bf55b-d553-41a8-a6d6-8aa01ec8cb75 tempest-CinderUnicodeTest-924680598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc8d3009-ecd9-4532-896d-3b5fdb29746c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-dc9bf55b-d553-41a8-a6d6-8aa01ec8cb75 tempest-CinderUnicodeTest-924680598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe4d38f4-6709-4627-9168-77fe84c7b31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:56 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-dc9bf55b-d553-41a8-a6d6-8aa01ec8cb75 tempest-CinderUnicodeTest-924680598 None] Volume bf992e0e-660f-45f8-b23f-0fee1a2a2641: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf992e0e-660f-45f8-b23f-0fee1a2a2641', 'volume_size': 1} Apr 28 19:26:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-dc9bf55b-d553-41a8-a6d6-8aa01ec8cb75 tempest-CinderUnicodeTest-924680598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:57 devstack sudo[93854]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1dabe6c8-95d5-4a5a-b715-39f266a82e1c tempest-CreateVolumesFromSourceVolumeTest-978811713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-8a0cacae-b2d0-4389-a7d7-5a9cc5190149" returned: 0 in 0.615s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:57 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1dabe6c8-95d5-4a5a-b715-39f266a82e1c tempest-CreateVolumesFromSourceVolumeTest-978811713 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:26:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1dabe6c8-95d5-4a5a-b715-39f266a82e1c tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.479s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0db7101f-d106-4f08-a9fb-8b6f11767fac tempest-VolumeDependencyTests-637805770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.971s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:57 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0db7101f-d106-4f08-a9fb-8b6f11767fac tempest-VolumeDependencyTests-637805770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1286974394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4dfb15c-39d3-42b3-a276-9ea429ee10b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dec47550fdfb4870b6e7667d4a4ef673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:26:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:26:50Z,use_quota=True,user_id='4b5be3fcfe14488181e5b7b0cbbb1bde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:26:57 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-0db7101f-d106-4f08-a9fb-8b6f11767fac tempest-VolumeDependencyTests-637805770 None] Creating volume e4dfb15c-39d3-42b3-a276-9ea429ee10b3 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:26:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0db7101f-d106-4f08-a9fb-8b6f11767fac tempest-VolumeDependencyTests-637805770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0db7101f-d106-4f08-a9fb-8b6f11767fac tempest-VolumeDependencyTests-637805770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:57 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0db7101f-d106-4f08-a9fb-8b6f11767fac tempest-VolumeDependencyTests-637805770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:26:57 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0db7101f-d106-4f08-a9fb-8b6f11767fac tempest-VolumeDependencyTests-637805770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:26:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0db7101f-d106-4f08-a9fb-8b6f11767fac tempest-VolumeDependencyTests-637805770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:57 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0db7101f-d106-4f08-a9fb-8b6f11767fac tempest-VolumeDependencyTests-637805770 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:26:57 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-0db7101f-d106-4f08-a9fb-8b6f11767fac tempest-VolumeDependencyTests-637805770 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:26:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0db7101f-d106-4f08-a9fb-8b6f11767fac tempest-VolumeDependencyTests-637805770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1dabe6c8-95d5-4a5a-b715-39f266a82e1c tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67c4e4ed-c6ae-42e7-aec2-99952e6a3f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a0cacae-b2d0-4389-a7d7-5a9cc5190149', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:57 devstack sudo[93857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3 1073741824 Apr 28 19:26:57 devstack sudo[93857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1dabe6c8-95d5-4a5a-b715-39f266a82e1c tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd4274b9-0aa0-4f93-afaa-c9e742a0db51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:57 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-1dabe6c8-95d5-4a5a-b715-39f266a82e1c tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Volume volume-8a0cacae-b2d0-4389-a7d7-5a9cc5190149 (8a0cacae-b2d0-4389-a7d7-5a9cc5190149): created successfully Apr 28 19:26:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1dabe6c8-95d5-4a5a-b715-39f266a82e1c tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd4274b9-0aa0-4f93-afaa-c9e742a0db51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1dabe6c8-95d5-4a5a-b715-39f266a82e1c tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Flow 'volume_create_manager' (43508cce-ee6d-43a2-be33-2f8e48f3b73f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:26:57 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-1dabe6c8-95d5-4a5a-b715-39f266a82e1c tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Created volume successfully. Apr 28 19:26:57 devstack sudo[93857]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0db7101f-d106-4f08-a9fb-8b6f11767fac tempest-VolumeDependencyTests-637805770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3 1073741824" returned: 0 in 0.773s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0db7101f-d106-4f08-a9fb-8b6f11767fac tempest-VolumeDependencyTests-637805770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:58 devstack sudo[93862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3 Apr 28 19:26:58 devstack sudo[93862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:58 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0e1a3b8a-e2ad-4ae8-a86b-a7974a792935 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Acquiring lock "cinder-8a0cacae-b2d0-4389-a7d7-5a9cc5190149-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:26:58 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0e1a3b8a-e2ad-4ae8-a86b-a7974a792935 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "cinder-8a0cacae-b2d0-4389-a7d7-5a9cc5190149-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:26:58 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0e1a3b8a-e2ad-4ae8-a86b-a7974a792935 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Acquiring lock "cinder-quobyte-8a0cacae-b2d0-4389-a7d7-5a9cc5190149" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:26:58 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0e1a3b8a-e2ad-4ae8-a86b-a7974a792935 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "cinder-quobyte-8a0cacae-b2d0-4389-a7d7-5a9cc5190149" acquired by "delete_volume" :: waited 0.016s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:26:58 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0600b8-e81b-4e98-89f4-70a29b3124b9]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:26:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0e1a3b8a-e2ad-4ae8-a86b-a7974a792935 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-8a0cacae-b2d0-4389-a7d7-5a9cc5190149 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:58 devstack sudo[93864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-8a0cacae-b2d0-4389-a7d7-5a9cc5190149 Apr 28 19:26:58 devstack sudo[93864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:58 devstack sudo[93862]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0db7101f-d106-4f08-a9fb-8b6f11767fac tempest-VolumeDependencyTests-637805770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3" returned: 0 in 0.621s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0db7101f-d106-4f08-a9fb-8b6f11767fac tempest-VolumeDependencyTests-637805770 None] <== create_volume: return (1437ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:26:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0db7101f-d106-4f08-a9fb-8b6f11767fac tempest-VolumeDependencyTests-637805770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.440s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 7.315s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:58 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] Acquiring lock "cinder-quobyte-9d170213-559b-48bd-82b3-269609d2373d-c9287d5c-9f40-439e-a9d5-7455d7561c53" by "_create_volume_from_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:26:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0db7101f-d106-4f08-a9fb-8b6f11767fac tempest-VolumeDependencyTests-637805770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c15dcaec-b72a-4e85-9d16-9b5e4f34fdba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0db7101f-d106-4f08-a9fb-8b6f11767fac tempest-VolumeDependencyTests-637805770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eac8641b-b408-4501-a5d1-e3a0892ea795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:26:58 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] Lock "cinder-quobyte-9d170213-559b-48bd-82b3-269609d2373d-c9287d5c-9f40-439e-a9d5-7455d7561c53" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:26:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] Creating volume c9287d5c-9f40-439e-a9d5-7455d7561c53 from snapshot 9d170213-559b-48bd-82b3-269609d2373d {{(pid=83863) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 28 19:26:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:26:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:26:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:26:58 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] Acquiring lock "cinder-quobyte-c9287d5c-9f40-439e-a9d5-7455d7561c53" by "_copy_volume_from_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:26:58 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-0db7101f-d106-4f08-a9fb-8b6f11767fac tempest-VolumeDependencyTests-637805770 None] Volume volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3 (e4dfb15c-39d3-42b3-a276-9ea429ee10b3): created successfully Apr 28 19:26:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0db7101f-d106-4f08-a9fb-8b6f11767fac tempest-VolumeDependencyTests-637805770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eac8641b-b408-4501-a5d1-e3a0892ea795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:26:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0db7101f-d106-4f08-a9fb-8b6f11767fac tempest-VolumeDependencyTests-637805770 None] Flow 'volume_create_manager' (ebd9b7ff-b753-4c4e-9ddc-7d02d53bbb6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:26:58 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] Lock "cinder-quobyte-c9287d5c-9f40-439e-a9d5-7455d7561c53" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:26:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] snapshot: 9d170213-559b-48bd-82b3-269609d2373d, volume: c9287d5c-9f40-439e-a9d5-7455d7561c53, {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 19:26:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:26:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:26:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:58 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-0db7101f-d106-4f08-a9fb-8b6f11767fac tempest-VolumeDependencyTests-637805770 None] Created volume successfully. Apr 28 19:26:58 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6391ac-bcf4-4f82-a5f2-235944aeeeb8]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:26:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb.9d170213-559b-48bd-82b3-269609d2373d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:58 devstack sudo[93867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb.9d170213-559b-48bd-82b3-269609d2373d Apr 28 19:26:58 devstack sudo[93867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:58 devstack sudo[93864]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0e1a3b8a-e2ad-4ae8-a86b-a7974a792935 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-8a0cacae-b2d0-4389-a7d7-5a9cc5190149" returned: 0 in 0.753s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0e1a3b8a-e2ad-4ae8-a86b-a7974a792935 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-8a0cacae-b2d0-4389-a7d7-5a9cc5190149 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:58 devstack sudo[93872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-8a0cacae-b2d0-4389-a7d7-5a9cc5190149 Apr 28 19:26:58 devstack sudo[93872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:59 devstack sudo[93867]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb.9d170213-559b-48bd-82b3-269609d2373d" returned: 0 in 0.743s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10db6bdd-2497-44a9-8434-15c06d8d00eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:26:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 19:26:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] Creating direct copy from snapshot {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 19:26:59 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b4e444-74e4-48c9-a83b-706fa046c7d3]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:26:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:59 devstack sudo[93872]: pam_unix(sudo:session): session closed for user root Apr 28 19:26:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0e1a3b8a-e2ad-4ae8-a86b-a7974a792935 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-8a0cacae-b2d0-4389-a7d7-5a9cc5190149" returned: 0 in 0.623s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:26:59 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0e1a3b8a-e2ad-4ae8-a86b-a7974a792935 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "cinder-quobyte-8a0cacae-b2d0-4389-a7d7-5a9cc5190149" released by "delete_volume" :: held 1.423s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:26:59 devstack sudo[93878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb Apr 28 19:26:59 devstack sudo[93878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:26:59 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-0e1a3b8a-e2ad-4ae8-a86b-a7974a792935 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Created reservations ['6574caa2-8c3a-4993-96b6-5b373b9e80fe', 'f881b711-1082-4a0c-a0bc-e75aa9585312', '33d6ddae-ccdf-410b-8163-f9359a1c3f2b', 'e87fdd5c-ac7a-41a5-a228-9d58e33be637'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:26:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0e1a3b8a-e2ad-4ae8-a86b-a7974a792935 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:26:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0e1a3b8a-e2ad-4ae8-a86b-a7974a792935 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:26:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0e1a3b8a-e2ad-4ae8-a86b-a7974a792935 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:26:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0e1a3b8a-e2ad-4ae8-a86b-a7974a792935 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:26:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0e1a3b8a-e2ad-4ae8-a86b-a7974a792935 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:26:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0e1a3b8a-e2ad-4ae8-a86b-a7974a792935 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:26:59 devstack sudo[93880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:26:59 devstack sudo[93880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:00 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:27:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Flow 'volume_create_manager' (2328b8d0-01d2-4a2f-924b-1e268c11f005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:27:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c12e6041-d11e-405a-8eaf-8fdd7d43a277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:27:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c12e6041-d11e-405a-8eaf-8fdd7d43a277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-617772187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2de8308c-809d-4a29-8227-227afd67becf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dec47550fdfb4870b6e7667d4a4ef673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=e4dfb15c-39d3-42b3-a276-9ea429ee10b3,status='creating',terminated_at=None,updated_at=2026-04-28T17:27:00Z,use_quota=True,user_id='4b5be3fcfe14488181e5b7b0cbbb1bde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:27:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc0063cf-ef99-4d15-ade6-7ebfc2d9c71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:27:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc0063cf-ef99-4d15-ade6-7ebfc2d9c71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:27:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a0c136b-372a-409c-9220-ee8e7b93524d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:27:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a0c136b-372a-409c-9220-ee8e7b93524d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2de8308c-809d-4a29-8227-227afd67becf', 'volume_name': 'volume-2de8308c-809d-4a29-8227-227afd67becf', 'volume_size': 1, 'source_volid': 'e4dfb15c-39d3-42b3-a276-9ea429ee10b3', 'source_volstatus': 'available'}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:27:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (422de181-3ad7-401a-9c92-ee67d388098d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:27:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (422de181-3ad7-401a-9c92-ee67d388098d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:27:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3436437d-0a55-4f7c-b851-563c6b808523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:27:00 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Volume 2de8308c-809d-4a29-8227-227afd67becf: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2de8308c-809d-4a29-8227-227afd67becf', 'volume_size': 1, 'source_volid': 'e4dfb15c-39d3-42b3-a276-9ea429ee10b3', 'source_volstatus': 'available'} Apr 28 19:27:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:27:00 devstack sudo[93878]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb" returned: 0 in 0.793s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:00 devstack cinder-volume[83863]: DEBUG cinder.utils [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] Path /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c9287d5c-9f40-439e-a9d5-7455d7561c53 not found in is_blk_device check {{(pid=83863) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 19:27:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c9287d5c-9f40-439e-a9d5-7455d7561c53 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:00 devstack sudo[93886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c9287d5c-9f40-439e-a9d5-7455d7561c53 Apr 28 19:27:00 devstack sudo[93886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:00 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7d046731-4a92-4c86-9c2f-b1acc229beb3 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Acquiring lock "cinder-3c14c9fd-5476-411a-aa60-08617b7e1f2f-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:27:00 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7d046731-4a92-4c86-9c2f-b1acc229beb3 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "cinder-3c14c9fd-5476-411a-aa60-08617b7e1f2f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:27:00 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7d046731-4a92-4c86-9c2f-b1acc229beb3 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Acquiring lock "cinder-quobyte-3c14c9fd-5476-411a-aa60-08617b7e1f2f" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:27:00 devstack sudo[93880]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0e1a3b8a-e2ad-4ae8-a86b-a7974a792935 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.658s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:00 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-0e1a3b8a-e2ad-4ae8-a86b-a7974a792935 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:27:00 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-0e1a3b8a-e2ad-4ae8-a86b-a7974a792935 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Deleted volume successfully. Apr 28 19:27:00 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7d046731-4a92-4c86-9c2f-b1acc229beb3 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "cinder-quobyte-3c14c9fd-5476-411a-aa60-08617b7e1f2f" acquired by "delete_volume" :: waited 0.023s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:27:00 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0e1a3b8a-e2ad-4ae8-a86b-a7974a792935 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "cinder-8a0cacae-b2d0-4389-a7d7-5a9cc5190149-delete_volume" released by "delete_volume" :: held 2.324s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:27:00 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9293b1a-bf94-40b4-9ff5-5151d966a085]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:27:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7d046731-4a92-4c86-9c2f-b1acc229beb3 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3c14c9fd-5476-411a-aa60-08617b7e1f2f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:00 devstack sudo[93888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3c14c9fd-5476-411a-aa60-08617b7e1f2f Apr 28 19:27:00 devstack sudo[93888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:01 devstack sudo[93888]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7d046731-4a92-4c86-9c2f-b1acc229beb3 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3c14c9fd-5476-411a-aa60-08617b7e1f2f" returned: 0 in 0.886s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7d046731-4a92-4c86-9c2f-b1acc229beb3 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3c14c9fd-5476-411a-aa60-08617b7e1f2f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:01 devstack sudo[93904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3c14c9fd-5476-411a-aa60-08617b7e1f2f Apr 28 19:27:01 devstack sudo[93904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:02 devstack sudo[93904]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7d046731-4a92-4c86-9c2f-b1acc229beb3 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-3c14c9fd-5476-411a-aa60-08617b7e1f2f" returned: 0 in 1.113s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:02 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7d046731-4a92-4c86-9c2f-b1acc229beb3 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "cinder-quobyte-3c14c9fd-5476-411a-aa60-08617b7e1f2f" released by "delete_volume" :: held 2.067s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:27:02 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:SELECT=138,cinder:UPDATE=183,cinder:INSERT=41,cinder:DELETE=19 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 19:27:02 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:UPDATE=185,cinder:SELECT=135,cinder:DELETE=18,cinder:INSERT=42 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 19:27:02 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-7d046731-4a92-4c86-9c2f-b1acc229beb3 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Created reservations ['cd9408ad-c1a2-4273-a886-6df4eb4c7318', '62509ff5-6980-467f-9f5b-c53974f11a84', 'e817684e-e4d4-4379-9897-6a5925ca0b6a', '26544b37-45f5-4260-878c-65f509ab1260'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:27:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7d046731-4a92-4c86-9c2f-b1acc229beb3 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:27:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7d046731-4a92-4c86-9c2f-b1acc229beb3 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:27:02 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7d046731-4a92-4c86-9c2f-b1acc229beb3 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:27:02 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7d046731-4a92-4c86-9c2f-b1acc229beb3 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:27:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7d046731-4a92-4c86-9c2f-b1acc229beb3 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:27:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7d046731-4a92-4c86-9c2f-b1acc229beb3 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:02 devstack sudo[93908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:27:02 devstack sudo[93908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:03 devstack cinder-volume[83863]: DEBUG oslo_service.periodic_task [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 28 19:27:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:27:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:27:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:27:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:27:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:27:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:03 devstack sudo[93910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:27:03 devstack sudo[93910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:03 devstack sudo[93908]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7d046731-4a92-4c86-9c2f-b1acc229beb3 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.994s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:03 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-7d046731-4a92-4c86-9c2f-b1acc229beb3 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:27:03 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-7d046731-4a92-4c86-9c2f-b1acc229beb3 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Deleted volume successfully. Apr 28 19:27:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7d046731-4a92-4c86-9c2f-b1acc229beb3 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "cinder-3c14c9fd-5476-411a-aa60-08617b7e1f2f-delete_volume" released by "delete_volume" :: held 3.573s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:27:04 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-1232e71e-775b-44e1-b3dd-c1ff38f6c838 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Acquiring lock "cinder-85fc9a94-bec6-4c0f-9819-f7e443ea86fb-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:27:04 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-1232e71e-775b-44e1-b3dd-c1ff38f6c838 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "cinder-85fc9a94-bec6-4c0f-9819-f7e443ea86fb-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:27:04 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-1232e71e-775b-44e1-b3dd-c1ff38f6c838 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Acquiring lock "cinder-quobyte-85fc9a94-bec6-4c0f-9819-f7e443ea86fb" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:27:04 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-1232e71e-775b-44e1-b3dd-c1ff38f6c838 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "cinder-quobyte-85fc9a94-bec6-4c0f-9819-f7e443ea86fb" acquired by "delete_volume" :: waited 0.028s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:27:04 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[31aa2cb4-f394-429a-9769-3ca307e69c2c]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:27:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1232e71e-775b-44e1-b3dd-c1ff38f6c838 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-85fc9a94-bec6-4c0f-9819-f7e443ea86fb {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:04 devstack sudo[93913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-85fc9a94-bec6-4c0f-9819-f7e443ea86fb Apr 28 19:27:04 devstack sudo[93913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:04 devstack sudo[93910]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 1.461s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:04 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-5a4906e7-a944-4563-b172-2b4c305e2207 None None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:27:05 devstack sudo[93913]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1232e71e-775b-44e1-b3dd-c1ff38f6c838 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-85fc9a94-bec6-4c0f-9819-f7e443ea86fb" returned: 0 in 1.574s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1232e71e-775b-44e1-b3dd-c1ff38f6c838 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-85fc9a94-bec6-4c0f-9819-f7e443ea86fb {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:05 devstack sudo[93919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-85fc9a94-bec6-4c0f-9819-f7e443ea86fb Apr 28 19:27:05 devstack sudo[93919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:05 devstack sudo[93886]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c9287d5c-9f40-439e-a9d5-7455d7561c53" returned: 0 in 5.584s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:05 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[292a4262-85cd-43a1-a64e-18a50b13412e]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:27:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:06 devstack sudo[93921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb Apr 28 19:27:06 devstack sudo[93921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:06 devstack sudo[93919]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1232e71e-775b-44e1-b3dd-c1ff38f6c838 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-85fc9a94-bec6-4c0f-9819-f7e443ea86fb" returned: 0 in 0.594s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:06 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-1232e71e-775b-44e1-b3dd-c1ff38f6c838 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "cinder-quobyte-85fc9a94-bec6-4c0f-9819-f7e443ea86fb" released by "delete_volume" :: held 2.263s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:27:06 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-1232e71e-775b-44e1-b3dd-c1ff38f6c838 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Created reservations ['a0029789-32a5-4060-bf40-863043c4bdf7', 'a2e28b82-22ec-401a-84d5-131115dd1a1b', '619b2446-4063-42d3-92f2-b0162f4ad618', '25632d4a-2c22-41ff-b548-215e7c664fc3'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:27:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1232e71e-775b-44e1-b3dd-c1ff38f6c838 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:27:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1232e71e-775b-44e1-b3dd-c1ff38f6c838 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:27:06 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1232e71e-775b-44e1-b3dd-c1ff38f6c838 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:27:06 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1232e71e-775b-44e1-b3dd-c1ff38f6c838 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:27:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1232e71e-775b-44e1-b3dd-c1ff38f6c838 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:27:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1232e71e-775b-44e1-b3dd-c1ff38f6c838 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:06 devstack sudo[93926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:27:06 devstack sudo[93926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:06 devstack sudo[93921]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb" returned: 0 in 0.931s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:06 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] Image conversion details: src /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb, size 1024.00 MB, duration 5.59 sec, destination /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c9287d5c-9f40-439e-a9d5-7455d7561c53 {{(pid=83863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 19:27:06 devstack cinder-volume[83863]: INFO cinder.image.image_utils [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] Converted 1024.00 MB image at 183.33 MB/s Apr 28 19:27:06 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c9287d5c-9f40-439e-a9d5-7455d7561c53 is being set with open permissions: ugo+rw Apr 28 19:27:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c9287d5c-9f40-439e-a9d5-7455d7561c53 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:06 devstack sudo[93929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c9287d5c-9f40-439e-a9d5-7455d7561c53 Apr 28 19:27:06 devstack sudo[93929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:07 devstack sudo[93926]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1232e71e-775b-44e1-b3dd-c1ff38f6c838 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.597s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:07 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-1232e71e-775b-44e1-b3dd-c1ff38f6c838 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:27:07 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-1232e71e-775b-44e1-b3dd-c1ff38f6c838 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Deleted volume successfully. Apr 28 19:27:07 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-1232e71e-775b-44e1-b3dd-c1ff38f6c838 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "cinder-85fc9a94-bec6-4c0f-9819-f7e443ea86fb-delete_volume" released by "delete_volume" :: held 3.095s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:27:07 devstack sudo[93929]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c9287d5c-9f40-439e-a9d5-7455d7561c53" returned: 0 in 0.629s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:07 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] Lock "cinder-quobyte-c9287d5c-9f40-439e-a9d5-7455d7561c53" released by "_copy_volume_from_snapshot" :: held 8.784s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:27:07 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] Lock "cinder-quobyte-9d170213-559b-48bd-82b3-269609d2373d-c9287d5c-9f40-439e-a9d5-7455d7561c53" released by "_create_volume_from_snapshot" :: held 8.840s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:27:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.877s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:27:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-dc9bf55b-d553-41a8-a6d6-8aa01ec8cb75 tempest-CinderUnicodeTest-924680598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.742s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:27:07 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-dc9bf55b-d553-41a8-a6d6-8aa01ec8cb75 tempest-CinderUnicodeTest-924680598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:26:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf992e0e-660f-45f8-b23f-0fee1a2a2641,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96578aae93ba4e759f9effaa51d814c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:26:57Z,use_quota=True,user_id='89b195fb07a844d08823ff41392be76c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:27:07 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-dc9bf55b-d553-41a8-a6d6-8aa01ec8cb75 tempest-CinderUnicodeTest-924680598 None] Creating volume bf992e0e-660f-45f8-b23f-0fee1a2a2641 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:27:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-dc9bf55b-d553-41a8-a6d6-8aa01ec8cb75 tempest-CinderUnicodeTest-924680598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:27:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-dc9bf55b-d553-41a8-a6d6-8aa01ec8cb75 tempest-CinderUnicodeTest-924680598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:27:07 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-dc9bf55b-d553-41a8-a6d6-8aa01ec8cb75 tempest-CinderUnicodeTest-924680598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:27:07 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-dc9bf55b-d553-41a8-a6d6-8aa01ec8cb75 tempest-CinderUnicodeTest-924680598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:27:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-dc9bf55b-d553-41a8-a6d6-8aa01ec8cb75 tempest-CinderUnicodeTest-924680598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:27:07 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-dc9bf55b-d553-41a8-a6d6-8aa01ec8cb75 tempest-CinderUnicodeTest-924680598 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:27:07 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-dc9bf55b-d553-41a8-a6d6-8aa01ec8cb75 tempest-CinderUnicodeTest-924680598 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:27:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-dc9bf55b-d553-41a8-a6d6-8aa01ec8cb75 tempest-CinderUnicodeTest-924680598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bf992e0e-660f-45f8-b23f-0fee1a2a2641 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:07 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4b367e6e-da9d-44ad-8178-e7ecc4821759 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Acquiring lock "cinder-f2b76522-a286-4f90-adf8-43101cfd64b1-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:27:07 devstack sudo[93933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bf992e0e-660f-45f8-b23f-0fee1a2a2641 1073741824 Apr 28 19:27:07 devstack sudo[93933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:07 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4b367e6e-da9d-44ad-8178-e7ecc4821759 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "cinder-f2b76522-a286-4f90-adf8-43101cfd64b1-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:27:07 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beff24c3-cca0-44c1-aa50-2e83768548c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9287d5c-9f40-439e-a9d5-7455d7561c53', 'volume_size': 1, 'snapshot_id': '9d170213-559b-48bd-82b3-269609d2373d'}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:27:07 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b7376ae-7d44-4923-898a-229249637942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:27:07 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] Volume volume-c9287d5c-9f40-439e-a9d5-7455d7561c53 (c9287d5c-9f40-439e-a9d5-7455d7561c53): created successfully Apr 28 19:27:07 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b7376ae-7d44-4923-898a-229249637942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:27:07 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] Flow 'volume_create_manager' (05542c4a-6734-41bb-8d93-a0a71ec6d8e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:27:07 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4b367e6e-da9d-44ad-8178-e7ecc4821759 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Acquiring lock "cinder-quobyte-f2b76522-a286-4f90-adf8-43101cfd64b1" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:27:07 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-7252835b-37e1-4457-95c1-d998b09ac876 tempest-SnapshotDependencyTests-840224214 None] Created volume successfully. Apr 28 19:27:07 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4b367e6e-da9d-44ad-8178-e7ecc4821759 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "cinder-quobyte-f2b76522-a286-4f90-adf8-43101cfd64b1" acquired by "delete_volume" :: waited 0.023s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:27:07 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d25409b-4ad1-49de-8a88-1a026863c745]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:27:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4b367e6e-da9d-44ad-8178-e7ecc4821759 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f2b76522-a286-4f90-adf8-43101cfd64b1 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:07 devstack sudo[93935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f2b76522-a286-4f90-adf8-43101cfd64b1 Apr 28 19:27:07 devstack sudo[93935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:08 devstack sudo[93933]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-dc9bf55b-d553-41a8-a6d6-8aa01ec8cb75 tempest-CinderUnicodeTest-924680598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bf992e0e-660f-45f8-b23f-0fee1a2a2641 1073741824" returned: 0 in 0.836s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-dc9bf55b-d553-41a8-a6d6-8aa01ec8cb75 tempest-CinderUnicodeTest-924680598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bf992e0e-660f-45f8-b23f-0fee1a2a2641 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:08 devstack sudo[93943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bf992e0e-660f-45f8-b23f-0fee1a2a2641 Apr 28 19:27:08 devstack sudo[93943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:08 devstack sudo[93935]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4b367e6e-da9d-44ad-8178-e7ecc4821759 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f2b76522-a286-4f90-adf8-43101cfd64b1" returned: 0 in 0.758s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4b367e6e-da9d-44ad-8178-e7ecc4821759 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f2b76522-a286-4f90-adf8-43101cfd64b1 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:08 devstack sudo[93945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f2b76522-a286-4f90-adf8-43101cfd64b1 Apr 28 19:27:08 devstack sudo[93945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:08 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-15e8acf7-6637-40f5-a551-59f62939fcd6 tempest-SnapshotDependencyTests-840224214 None] Acquiring lock "cinder-9d170213-559b-48bd-82b3-269609d2373d-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:27:08 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-15e8acf7-6637-40f5-a551-59f62939fcd6 tempest-SnapshotDependencyTests-840224214 None] Lock "cinder-9d170213-559b-48bd-82b3-269609d2373d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:27:08 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-15e8acf7-6637-40f5-a551-59f62939fcd6 tempest-SnapshotDependencyTests-840224214 None] Acquiring lock "cinder-quobyte-10db6bdd-2497-44a9-8434-15c06d8d00eb" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:27:08 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-15e8acf7-6637-40f5-a551-59f62939fcd6 tempest-SnapshotDependencyTests-840224214 None] Lock "cinder-quobyte-10db6bdd-2497-44a9-8434-15c06d8d00eb" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:27:08 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-15e8acf7-6637-40f5-a551-59f62939fcd6 tempest-SnapshotDependencyTests-840224214 None] Acquiring lock "cinder-quobyte-9d170213-559b-48bd-82b3-269609d2373d" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:27:08 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-15e8acf7-6637-40f5-a551-59f62939fcd6 tempest-SnapshotDependencyTests-840224214 None] Lock "cinder-quobyte-9d170213-559b-48bd-82b3-269609d2373d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:27:08 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-15e8acf7-6637-40f5-a551-59f62939fcd6 tempest-SnapshotDependencyTests-840224214 None] Deleting offline snapshot 9d170213-559b-48bd-82b3-269609d2373d of volume 10db6bdd-2497-44a9-8434-15c06d8d00eb {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 19:27:08 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-15e8acf7-6637-40f5-a551-59f62939fcd6 tempest-SnapshotDependencyTests-840224214 None] snapshot_file for this snap is: volume-10db6bdd-2497-44a9-8434-15c06d8d00eb.9d170213-559b-48bd-82b3-269609d2373d {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 19:27:08 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[de920f20-b24c-4570-aad2-3572ca346147]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:27:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-15e8acf7-6637-40f5-a551-59f62939fcd6 tempest-SnapshotDependencyTests-840224214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb.9d170213-559b-48bd-82b3-269609d2373d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:08 devstack sudo[93947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb.9d170213-559b-48bd-82b3-269609d2373d Apr 28 19:27:08 devstack sudo[93947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:09 devstack sudo[93943]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-dc9bf55b-d553-41a8-a6d6-8aa01ec8cb75 tempest-CinderUnicodeTest-924680598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bf992e0e-660f-45f8-b23f-0fee1a2a2641" returned: 0 in 0.661s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:09 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-dc9bf55b-d553-41a8-a6d6-8aa01ec8cb75 tempest-CinderUnicodeTest-924680598 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:27:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-dc9bf55b-d553-41a8-a6d6-8aa01ec8cb75 tempest-CinderUnicodeTest-924680598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:27:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 8.826s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:27:09 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Cloning volume e4dfb15c-39d3-42b3-a276-9ea429ee10b3 to volume 2de8308c-809d-4a29-8227-227afd67becf Apr 28 19:27:09 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-dc9bf55b-d553-41a8-a6d6-8aa01ec8cb75 tempest-CinderUnicodeTest-924680598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe4d38f4-6709-4627-9168-77fe84c7b31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf992e0e-660f-45f8-b23f-0fee1a2a2641', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:27:09 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-dc9bf55b-d553-41a8-a6d6-8aa01ec8cb75 tempest-CinderUnicodeTest-924680598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85ac8321-3ff0-4737-8d80-4bfe4fb9883c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:27:09 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-dc9bf55b-d553-41a8-a6d6-8aa01ec8cb75 tempest-CinderUnicodeTest-924680598 None] Volume volume-bf992e0e-660f-45f8-b23f-0fee1a2a2641 (bf992e0e-660f-45f8-b23f-0fee1a2a2641): created successfully Apr 28 19:27:09 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-dc9bf55b-d553-41a8-a6d6-8aa01ec8cb75 tempest-CinderUnicodeTest-924680598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85ac8321-3ff0-4737-8d80-4bfe4fb9883c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:27:09 devstack sudo[93945]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:09 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-dc9bf55b-d553-41a8-a6d6-8aa01ec8cb75 tempest-CinderUnicodeTest-924680598 None] Flow 'volume_create_manager' (cbae6f86-9a4c-495e-a987-971d71d09ded) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:27:09 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Creating offline snapshot 910b3134-0a0d-4c0a-9765-8abe68169b40 of volume e4dfb15c-39d3-42b3-a276-9ea429ee10b3 {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 19:27:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4b367e6e-da9d-44ad-8178-e7ecc4821759 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-f2b76522-a286-4f90-adf8-43101cfd64b1" returned: 0 in 0.705s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:09 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f0cdd8-c5bf-4069-93c0-4ecf4b5647de]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:27:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:09 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4b367e6e-da9d-44ad-8178-e7ecc4821759 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "cinder-quobyte-f2b76522-a286-4f90-adf8-43101cfd64b1" released by "delete_volume" :: held 1.525s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:27:09 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-dc9bf55b-d553-41a8-a6d6-8aa01ec8cb75 tempest-CinderUnicodeTest-924680598 None] Created volume successfully. Apr 28 19:27:09 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-4b367e6e-da9d-44ad-8178-e7ecc4821759 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Created reservations ['341cafb1-f517-44d5-988f-e8b21f734e73', 'b5a9b6b3-1c86-46bd-8106-ffee7850b439', '2b6adba3-eb3c-493c-a865-f586aa976acd', '7406028b-55a3-41d4-945a-417342144c44'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:27:09 devstack sudo[93951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3 Apr 28 19:27:09 devstack sudo[93951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4b367e6e-da9d-44ad-8178-e7ecc4821759 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:27:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4b367e6e-da9d-44ad-8178-e7ecc4821759 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:27:09 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4b367e6e-da9d-44ad-8178-e7ecc4821759 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:27:09 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4b367e6e-da9d-44ad-8178-e7ecc4821759 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:27:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4b367e6e-da9d-44ad-8178-e7ecc4821759 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:27:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4b367e6e-da9d-44ad-8178-e7ecc4821759 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:09 devstack sudo[93956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:27:09 devstack sudo[93956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:09 devstack sudo[93947]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-15e8acf7-6637-40f5-a551-59f62939fcd6 tempest-SnapshotDependencyTests-840224214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb.9d170213-559b-48bd-82b3-269609d2373d" returned: 0 in 0.805s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:09 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-15e8acf7-6637-40f5-a551-59f62939fcd6 tempest-SnapshotDependencyTests-840224214 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10db6bdd-2497-44a9-8434-15c06d8d00eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:27:09 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[873ff79e-4c19-4935-8fa7-6ff3b031aa1c]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:27:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-15e8acf7-6637-40f5-a551-59f62939fcd6 tempest-SnapshotDependencyTests-840224214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:09 devstack sudo[93958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb Apr 28 19:27:09 devstack sudo[93958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:09 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-70d23dd0-3431-4ade-a77d-33e2749eb881 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Acquiring lock "cinder-d7528466-f088-4468-b9ba-dbafe05674d5-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:27:09 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-70d23dd0-3431-4ade-a77d-33e2749eb881 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "cinder-d7528466-f088-4468-b9ba-dbafe05674d5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:27:09 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-70d23dd0-3431-4ade-a77d-33e2749eb881 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Acquiring lock "cinder-quobyte-d7528466-f088-4468-b9ba-dbafe05674d5" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:27:09 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-70d23dd0-3431-4ade-a77d-33e2749eb881 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "cinder-quobyte-d7528466-f088-4468-b9ba-dbafe05674d5" acquired by "delete_volume" :: waited 0.016s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:27:09 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4861033d-db3e-44cd-93ff-b56f58c44e29]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:27:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-70d23dd0-3431-4ade-a77d-33e2749eb881 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d7528466-f088-4468-b9ba-dbafe05674d5 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:10 devstack sudo[93951]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3" returned: 0 in 0.904s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3.910b3134-0a0d-4c0a-9765-8abe68169b40 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:10 devstack sudo[93956]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4b367e6e-da9d-44ad-8178-e7ecc4821759 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.792s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:10 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-4b367e6e-da9d-44ad-8178-e7ecc4821759 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:27:10 devstack sudo[93964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d7528466-f088-4468-b9ba-dbafe05674d5 Apr 28 19:27:10 devstack sudo[93964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:10 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-4b367e6e-da9d-44ad-8178-e7ecc4821759 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Deleted volume successfully. Apr 28 19:27:10 devstack sudo[93965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3.910b3134-0a0d-4c0a-9765-8abe68169b40 1G Apr 28 19:27:10 devstack sudo[93965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:10 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4b367e6e-da9d-44ad-8178-e7ecc4821759 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "cinder-f2b76522-a286-4f90-adf8-43101cfd64b1-delete_volume" released by "delete_volume" :: held 2.578s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:27:10 devstack sudo[93958]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-15e8acf7-6637-40f5-a551-59f62939fcd6 tempest-SnapshotDependencyTests-840224214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb" returned: 0 in 0.928s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-15e8acf7-6637-40f5-a551-59f62939fcd6 tempest-SnapshotDependencyTests-840224214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb.9d170213-559b-48bd-82b3-269609d2373d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:10 devstack sudo[93971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb.9d170213-559b-48bd-82b3-269609d2373d Apr 28 19:27:10 devstack sudo[93971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:10 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a76f59f-1708-4184-a057-e0d81d40c95a tempest-CinderUnicodeTest-924680598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 19:27:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0a76f59f-1708-4184-a057-e0d81d40c95a tempest-CinderUnicodeTest-924680598 None] Flow 'volume_create_manager' (91075125-b85d-4ac9-9c98-b6df3bb8bbf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:27:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0a76f59f-1708-4184-a057-e0d81d40c95a tempest-CinderUnicodeTest-924680598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6e49c5f-a4ac-4e93-87db-07cec4e97598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:27:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0a76f59f-1708-4184-a057-e0d81d40c95a tempest-CinderUnicodeTest-924680598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6e49c5f-a4ac-4e93-87db-07cec4e97598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:27:10Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1597134121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07342e2f-242b-48f9-990c-c65ab2103ee0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96578aae93ba4e759f9effaa51d814c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:27:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:27:10Z,use_quota=True,user_id='89b195fb07a844d08823ff41392be76c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:27:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0a76f59f-1708-4184-a057-e0d81d40c95a tempest-CinderUnicodeTest-924680598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27b2a902-5dbe-4178-bf48-3f3b24b2a3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:27:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0a76f59f-1708-4184-a057-e0d81d40c95a tempest-CinderUnicodeTest-924680598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27b2a902-5dbe-4178-bf48-3f3b24b2a3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:27:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0a76f59f-1708-4184-a057-e0d81d40c95a tempest-CinderUnicodeTest-924680598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78dc1b65-020d-48c6-8b29-60de7a11ef14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:27:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0a76f59f-1708-4184-a057-e0d81d40c95a tempest-CinderUnicodeTest-924680598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78dc1b65-020d-48c6-8b29-60de7a11ef14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07342e2f-242b-48f9-990c-c65ab2103ee0', 'volume_name': 'volume-07342e2f-242b-48f9-990c-c65ab2103ee0', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:27:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0a76f59f-1708-4184-a057-e0d81d40c95a tempest-CinderUnicodeTest-924680598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05ff1581-6ca0-4551-933c-5370b942ca4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:27:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0a76f59f-1708-4184-a057-e0d81d40c95a tempest-CinderUnicodeTest-924680598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05ff1581-6ca0-4551-933c-5370b942ca4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:27:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0a76f59f-1708-4184-a057-e0d81d40c95a tempest-CinderUnicodeTest-924680598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfef286d-763e-494d-9950-e45fb68dd563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:27:10 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-0a76f59f-1708-4184-a057-e0d81d40c95a tempest-CinderUnicodeTest-924680598 None] Volume 07342e2f-242b-48f9-990c-c65ab2103ee0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07342e2f-242b-48f9-990c-c65ab2103ee0', 'volume_size': 1} Apr 28 19:27:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0a76f59f-1708-4184-a057-e0d81d40c95a tempest-CinderUnicodeTest-924680598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:27:10 devstack sudo[93964]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-70d23dd0-3431-4ade-a77d-33e2749eb881 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d7528466-f088-4468-b9ba-dbafe05674d5" returned: 0 in 0.951s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-70d23dd0-3431-4ade-a77d-33e2749eb881 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d7528466-f088-4468-b9ba-dbafe05674d5 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:10 devstack sudo[93980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d7528466-f088-4468-b9ba-dbafe05674d5 Apr 28 19:27:10 devstack sudo[93980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:11 devstack sudo[93965]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3.910b3134-0a0d-4c0a-9765-8abe68169b40 1G" returned: 0 in 0.992s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3.910b3134-0a0d-4c0a-9765-8abe68169b40 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:11 devstack sudo[93986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3.910b3134-0a0d-4c0a-9765-8abe68169b40 Apr 28 19:27:11 devstack sudo[93986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:11 devstack sudo[93971]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-15e8acf7-6637-40f5-a551-59f62939fcd6 tempest-SnapshotDependencyTests-840224214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb.9d170213-559b-48bd-82b3-269609d2373d" returned: 0 in 0.818s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-15e8acf7-6637-40f5-a551-59f62939fcd6 tempest-SnapshotDependencyTests-840224214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb.9d170213-559b-48bd-82b3-269609d2373d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:11 devstack sudo[93988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb.9d170213-559b-48bd-82b3-269609d2373d Apr 28 19:27:11 devstack sudo[93988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:11 devstack sudo[93980]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-70d23dd0-3431-4ade-a77d-33e2749eb881 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-d7528466-f088-4468-b9ba-dbafe05674d5" returned: 0 in 0.646s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:11 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-70d23dd0-3431-4ade-a77d-33e2749eb881 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "cinder-quobyte-d7528466-f088-4468-b9ba-dbafe05674d5" released by "delete_volume" :: held 1.654s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:27:11 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-70d23dd0-3431-4ade-a77d-33e2749eb881 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Created reservations ['cf479caf-c1de-4962-8227-77256fc32557', '69073ab8-db55-431f-b01e-f410e82b1254', 'ba1b9451-487a-4949-adcb-3e6797d5a5fa', '990143b4-bfcd-4a9f-b37c-77fc1450ef6d'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:27:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-70d23dd0-3431-4ade-a77d-33e2749eb881 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:27:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-70d23dd0-3431-4ade-a77d-33e2749eb881 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:27:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-70d23dd0-3431-4ade-a77d-33e2749eb881 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:27:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-70d23dd0-3431-4ade-a77d-33e2749eb881 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:27:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-70d23dd0-3431-4ade-a77d-33e2749eb881 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:27:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-70d23dd0-3431-4ade-a77d-33e2749eb881 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:11 devstack sudo[93994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:27:11 devstack sudo[93994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:11 devstack sudo[93986]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3.910b3134-0a0d-4c0a-9765-8abe68169b40" returned: 0 in 0.723s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:11 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3.910b3134-0a0d-4c0a-9765-8abe68169b40 is being set with open permissions: ugo+rw Apr 28 19:27:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3.910b3134-0a0d-4c0a-9765-8abe68169b40 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:11 devstack sudo[93997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3.910b3134-0a0d-4c0a-9765-8abe68169b40 Apr 28 19:27:11 devstack sudo[93997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:11 devstack sudo[93988]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-15e8acf7-6637-40f5-a551-59f62939fcd6 tempest-SnapshotDependencyTests-840224214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb.9d170213-559b-48bd-82b3-269609d2373d" returned: 0 in 0.649s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:11 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-15e8acf7-6637-40f5-a551-59f62939fcd6 tempest-SnapshotDependencyTests-840224214 None] Lock "cinder-quobyte-9d170213-559b-48bd-82b3-269609d2373d" released by "_delete_snapshot" :: held 3.323s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:27:11 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-15e8acf7-6637-40f5-a551-59f62939fcd6 tempest-SnapshotDependencyTests-840224214 None] Lock "cinder-quobyte-10db6bdd-2497-44a9-8434-15c06d8d00eb" released by "delete_snapshot" :: held 3.353s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:27:11 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-15e8acf7-6637-40f5-a551-59f62939fcd6 tempest-SnapshotDependencyTests-840224214 None] Created reservations ['c19ee247-1b2a-4a77-aef3-9a03bda492b8', 'fa7606a0-31f5-4b1a-9ca2-06a4c7abe36a', 'f8e2d173-ba65-4741-994b-b6d758349fff', 'f5ecf0b5-68f9-4eb4-adbd-82cb9b70c345'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:27:12 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-15e8acf7-6637-40f5-a551-59f62939fcd6 tempest-SnapshotDependencyTests-840224214 None] Delete snapshot completed successfully. Apr 28 19:27:12 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3f0edf66-4f9e-4baf-9815-4c488dd0b672 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Acquiring lock "cinder-49f9e81d-937d-422a-82fc-2eb2f9de5ebf-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:27:12 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-15e8acf7-6637-40f5-a551-59f62939fcd6 tempest-SnapshotDependencyTests-840224214 None] Lock "cinder-9d170213-559b-48bd-82b3-269609d2373d-delete_snapshot" released by "delete_snapshot" :: held 3.539s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:27:12 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3f0edf66-4f9e-4baf-9815-4c488dd0b672 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "cinder-49f9e81d-937d-422a-82fc-2eb2f9de5ebf-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:27:12 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3f0edf66-4f9e-4baf-9815-4c488dd0b672 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Acquiring lock "cinder-quobyte-49f9e81d-937d-422a-82fc-2eb2f9de5ebf" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:27:12 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3f0edf66-4f9e-4baf-9815-4c488dd0b672 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "cinder-quobyte-49f9e81d-937d-422a-82fc-2eb2f9de5ebf" acquired by "delete_volume" :: waited 0.019s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:27:12 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d78851-91a4-4d31-af19-062263c26e40]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:27:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3f0edf66-4f9e-4baf-9815-4c488dd0b672 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-49f9e81d-937d-422a-82fc-2eb2f9de5ebf {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:12 devstack sudo[93999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-49f9e81d-937d-422a-82fc-2eb2f9de5ebf Apr 28 19:27:12 devstack sudo[93999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:12 devstack sudo[93994]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-70d23dd0-3431-4ade-a77d-33e2749eb881 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.668s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:12 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-70d23dd0-3431-4ade-a77d-33e2749eb881 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:27:12 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-70d23dd0-3431-4ade-a77d-33e2749eb881 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Deleted volume successfully. Apr 28 19:27:12 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-70d23dd0-3431-4ade-a77d-33e2749eb881 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "cinder-d7528466-f088-4468-b9ba-dbafe05674d5-delete_volume" released by "delete_volume" :: held 2.575s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:27:12 devstack sudo[93997]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3.910b3134-0a0d-4c0a-9765-8abe68169b40" returned: 0 in 0.663s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:12 devstack sudo[94003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3.info Apr 28 19:27:12 devstack sudo[94003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:12 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-776873fe-9576-4a3d-a1bb-6b31e31ddbbf tempest-SnapshotDependencyTests-840224214 None] Acquiring lock "cinder-10db6bdd-2497-44a9-8434-15c06d8d00eb-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:27:12 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-776873fe-9576-4a3d-a1bb-6b31e31ddbbf tempest-SnapshotDependencyTests-840224214 None] Lock "cinder-10db6bdd-2497-44a9-8434-15c06d8d00eb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:27:12 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-776873fe-9576-4a3d-a1bb-6b31e31ddbbf tempest-SnapshotDependencyTests-840224214 None] Acquiring lock "cinder-quobyte-10db6bdd-2497-44a9-8434-15c06d8d00eb" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:27:12 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-776873fe-9576-4a3d-a1bb-6b31e31ddbbf tempest-SnapshotDependencyTests-840224214 None] Lock "cinder-quobyte-10db6bdd-2497-44a9-8434-15c06d8d00eb" acquired by "delete_volume" :: waited 0.016s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:27:12 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[372d6339-5ed0-439d-ab53-f5b0ede9b14c]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:27:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-776873fe-9576-4a3d-a1bb-6b31e31ddbbf tempest-SnapshotDependencyTests-840224214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:12 devstack sudo[93999]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3f0edf66-4f9e-4baf-9815-4c488dd0b672 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-49f9e81d-937d-422a-82fc-2eb2f9de5ebf" returned: 0 in 0.765s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3f0edf66-4f9e-4baf-9815-4c488dd0b672 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-49f9e81d-937d-422a-82fc-2eb2f9de5ebf {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:12 devstack sudo[94009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-49f9e81d-937d-422a-82fc-2eb2f9de5ebf Apr 28 19:27:12 devstack sudo[94009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:12 devstack sudo[94008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb Apr 28 19:27:12 devstack sudo[94008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:13 devstack sudo[94003]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3.info" returned: 0 in 0.691s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:13 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3.info is being set with open permissions: ugo+rw Apr 28 19:27:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:13 devstack sudo[94013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3.info Apr 28 19:27:13 devstack sudo[94013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:13 devstack sudo[94009]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3f0edf66-4f9e-4baf-9815-4c488dd0b672 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-49f9e81d-937d-422a-82fc-2eb2f9de5ebf" returned: 0 in 0.640s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:13 devstack sudo[94008]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-776873fe-9576-4a3d-a1bb-6b31e31ddbbf tempest-SnapshotDependencyTests-840224214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb" returned: 0 in 0.722s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-776873fe-9576-4a3d-a1bb-6b31e31ddbbf tempest-SnapshotDependencyTests-840224214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:13 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3f0edf66-4f9e-4baf-9815-4c488dd0b672 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "cinder-quobyte-49f9e81d-937d-422a-82fc-2eb2f9de5ebf" released by "delete_volume" :: held 1.477s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:27:13 devstack sudo[94019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb Apr 28 19:27:13 devstack sudo[94019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:13 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-3f0edf66-4f9e-4baf-9815-4c488dd0b672 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Created reservations ['6a2bf4df-7972-4e0f-8201-4bf50ef99151', '99e88d75-91e1-4f43-8041-a9809f67384b', '3ede8baa-4ec4-4bdd-80f7-2d40719ab133', 'e91be74a-3fc3-4fa2-9f88-53c89f49b318'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:27:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3f0edf66-4f9e-4baf-9815-4c488dd0b672 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:27:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3f0edf66-4f9e-4baf-9815-4c488dd0b672 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:27:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3f0edf66-4f9e-4baf-9815-4c488dd0b672 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:27:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3f0edf66-4f9e-4baf-9815-4c488dd0b672 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:27:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3f0edf66-4f9e-4baf-9815-4c488dd0b672 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:27:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3f0edf66-4f9e-4baf-9815-4c488dd0b672 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:13 devstack sudo[94022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:27:13 devstack sudo[94022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:13 devstack sudo[94013]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3.info" returned: 0 in 0.690s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:13 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Acquiring lock "cinder-quobyte-2de8308c-809d-4a29-8227-227afd67becf" by "_copy_volume_from_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:27:13 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Lock "cinder-quobyte-2de8308c-809d-4a29-8227-227afd67becf" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:27:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] snapshot: 910b3134-0a0d-4c0a-9765-8abe68169b40, volume: 2de8308c-809d-4a29-8227-227afd67becf, {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 19:27:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:27:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:27:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:27:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:27:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:27:13 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da5cbfd-7b08-4291-aa65-d44010a92674]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:27:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3.910b3134-0a0d-4c0a-9765-8abe68169b40 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:14 devstack sudo[94024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3.910b3134-0a0d-4c0a-9765-8abe68169b40 Apr 28 19:27:14 devstack sudo[94024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:14 devstack sudo[94019]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-776873fe-9576-4a3d-a1bb-6b31e31ddbbf tempest-SnapshotDependencyTests-840224214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-10db6bdd-2497-44a9-8434-15c06d8d00eb" returned: 0 in 0.607s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:14 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-776873fe-9576-4a3d-a1bb-6b31e31ddbbf tempest-SnapshotDependencyTests-840224214 None] Lock "cinder-quobyte-10db6bdd-2497-44a9-8434-15c06d8d00eb" released by "delete_volume" :: held 1.419s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:27:14 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-776873fe-9576-4a3d-a1bb-6b31e31ddbbf tempest-SnapshotDependencyTests-840224214 None] Created reservations ['283c0839-ba27-4528-9b40-38c7dfba0412', 'e2d64220-d91f-4066-a75c-e1977dcb383b', 'ef6f8d65-0a0a-438a-a614-83fc5edc954e', '8d0fd436-445a-421a-8128-50b927e27ee0'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:27:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-776873fe-9576-4a3d-a1bb-6b31e31ddbbf tempest-SnapshotDependencyTests-840224214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:27:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-776873fe-9576-4a3d-a1bb-6b31e31ddbbf tempest-SnapshotDependencyTests-840224214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:27:14 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-776873fe-9576-4a3d-a1bb-6b31e31ddbbf tempest-SnapshotDependencyTests-840224214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:27:14 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-776873fe-9576-4a3d-a1bb-6b31e31ddbbf tempest-SnapshotDependencyTests-840224214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:27:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-776873fe-9576-4a3d-a1bb-6b31e31ddbbf tempest-SnapshotDependencyTests-840224214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:27:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-776873fe-9576-4a3d-a1bb-6b31e31ddbbf tempest-SnapshotDependencyTests-840224214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:14 devstack sudo[94028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:27:14 devstack sudo[94028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:14 devstack sudo[94022]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3f0edf66-4f9e-4baf-9815-4c488dd0b672 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.710s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:14 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-3f0edf66-4f9e-4baf-9815-4c488dd0b672 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:27:14 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-3f0edf66-4f9e-4baf-9815-4c488dd0b672 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Deleted volume successfully. Apr 28 19:27:14 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3f0edf66-4f9e-4baf-9815-4c488dd0b672 tempest-CreateVolumesFromSourceVolumeTest-978811713 None] Lock "cinder-49f9e81d-937d-422a-82fc-2eb2f9de5ebf-delete_volume" released by "delete_volume" :: held 2.453s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:27:14 devstack sudo[94024]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3.910b3134-0a0d-4c0a-9765-8abe68169b40" returned: 0 in 0.831s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:14 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:27:14 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3 {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 19:27:14 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Creating direct copy from snapshot {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 19:27:14 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10f9501-7c2d-4926-ade3-e322b68ae10d]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:27:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:14 devstack sudo[94033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3 Apr 28 19:27:14 devstack sudo[94033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:15 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-f4a87892-ee54-43ad-8ac8-35060ec5da1e tempest-SnapshotDependencyTests-840224214 None] Acquiring lock "cinder-c9287d5c-9f40-439e-a9d5-7455d7561c53-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:27:15 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-f4a87892-ee54-43ad-8ac8-35060ec5da1e tempest-SnapshotDependencyTests-840224214 None] Lock "cinder-c9287d5c-9f40-439e-a9d5-7455d7561c53-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:27:15 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-f4a87892-ee54-43ad-8ac8-35060ec5da1e tempest-SnapshotDependencyTests-840224214 None] Acquiring lock "cinder-quobyte-c9287d5c-9f40-439e-a9d5-7455d7561c53" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:27:15 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-f4a87892-ee54-43ad-8ac8-35060ec5da1e tempest-SnapshotDependencyTests-840224214 None] Lock "cinder-quobyte-c9287d5c-9f40-439e-a9d5-7455d7561c53" acquired by "delete_volume" :: waited 0.018s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:27:15 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9382f7-bb0a-4628-8688-bf88567296ea]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:27:15 devstack sudo[94028]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f4a87892-ee54-43ad-8ac8-35060ec5da1e tempest-SnapshotDependencyTests-840224214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c9287d5c-9f40-439e-a9d5-7455d7561c53 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-776873fe-9576-4a3d-a1bb-6b31e31ddbbf tempest-SnapshotDependencyTests-840224214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.757s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:15 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-776873fe-9576-4a3d-a1bb-6b31e31ddbbf tempest-SnapshotDependencyTests-840224214 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:27:15 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-776873fe-9576-4a3d-a1bb-6b31e31ddbbf tempest-SnapshotDependencyTests-840224214 None] Deleted volume successfully. Apr 28 19:27:15 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-776873fe-9576-4a3d-a1bb-6b31e31ddbbf tempest-SnapshotDependencyTests-840224214 None] Lock "cinder-10db6bdd-2497-44a9-8434-15c06d8d00eb-delete_volume" released by "delete_volume" :: held 2.446s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:27:15 devstack sudo[94036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c9287d5c-9f40-439e-a9d5-7455d7561c53 Apr 28 19:27:15 devstack sudo[94036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:15 devstack sudo[94033]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3" returned: 0 in 0.989s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:15 devstack cinder-volume[83863]: DEBUG cinder.utils [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Path /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2de8308c-809d-4a29-8227-227afd67becf not found in is_blk_device check {{(pid=83863) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 19:27:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2de8308c-809d-4a29-8227-227afd67becf {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:15 devstack sudo[94041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2de8308c-809d-4a29-8227-227afd67becf Apr 28 19:27:15 devstack sudo[94041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:15 devstack sudo[94036]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f4a87892-ee54-43ad-8ac8-35060ec5da1e tempest-SnapshotDependencyTests-840224214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c9287d5c-9f40-439e-a9d5-7455d7561c53" returned: 0 in 0.812s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f4a87892-ee54-43ad-8ac8-35060ec5da1e tempest-SnapshotDependencyTests-840224214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c9287d5c-9f40-439e-a9d5-7455d7561c53 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:16 devstack sudo[94046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c9287d5c-9f40-439e-a9d5-7455d7561c53 Apr 28 19:27:16 devstack sudo[94046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:16 devstack sudo[94046]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f4a87892-ee54-43ad-8ac8-35060ec5da1e tempest-SnapshotDependencyTests-840224214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-c9287d5c-9f40-439e-a9d5-7455d7561c53" returned: 0 in 0.688s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:16 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-f4a87892-ee54-43ad-8ac8-35060ec5da1e tempest-SnapshotDependencyTests-840224214 None] Lock "cinder-quobyte-c9287d5c-9f40-439e-a9d5-7455d7561c53" released by "delete_volume" :: held 1.560s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:27:16 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-f4a87892-ee54-43ad-8ac8-35060ec5da1e tempest-SnapshotDependencyTests-840224214 None] Created reservations ['ca89671c-74ca-4b8c-99c5-7c49a2d5c9c7', '53592a03-78a5-47d6-b6f9-2588825f4278', 'ec5b44ef-8416-488b-a511-ebb701b4ecb9', 'b433508b-0f74-4f54-bcbc-fa25140be535'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:27:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f4a87892-ee54-43ad-8ac8-35060ec5da1e tempest-SnapshotDependencyTests-840224214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:27:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f4a87892-ee54-43ad-8ac8-35060ec5da1e tempest-SnapshotDependencyTests-840224214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:27:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f4a87892-ee54-43ad-8ac8-35060ec5da1e tempest-SnapshotDependencyTests-840224214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:27:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f4a87892-ee54-43ad-8ac8-35060ec5da1e tempest-SnapshotDependencyTests-840224214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:27:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f4a87892-ee54-43ad-8ac8-35060ec5da1e tempest-SnapshotDependencyTests-840224214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:27:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f4a87892-ee54-43ad-8ac8-35060ec5da1e tempest-SnapshotDependencyTests-840224214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:17 devstack sudo[94059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:27:17 devstack sudo[94059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:18 devstack sudo[94059]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f4a87892-ee54-43ad-8ac8-35060ec5da1e tempest-SnapshotDependencyTests-840224214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 1.124s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:18 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-f4a87892-ee54-43ad-8ac8-35060ec5da1e tempest-SnapshotDependencyTests-840224214 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:27:18 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-f4a87892-ee54-43ad-8ac8-35060ec5da1e tempest-SnapshotDependencyTests-840224214 None] Deleted volume successfully. Apr 28 19:27:18 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-f4a87892-ee54-43ad-8ac8-35060ec5da1e tempest-SnapshotDependencyTests-840224214 None] Lock "cinder-c9287d5c-9f40-439e-a9d5-7455d7561c53-delete_volume" released by "delete_volume" :: held 3.190s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:27:21 devstack sudo[94041]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2de8308c-809d-4a29-8227-227afd67becf" returned: 0 in 5.366s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:21 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[91fc7124-6d1d-4c1e-9c78-25cfd2e25cfd]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:27:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:21 devstack sudo[94066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3 Apr 28 19:27:21 devstack sudo[94066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:22 devstack sudo[94066]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3" returned: 0 in 0.897s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:22 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Image conversion details: src /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3, size 1024.00 MB, duration 5.37 sec, destination /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2de8308c-809d-4a29-8227-227afd67becf {{(pid=83863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 19:27:22 devstack cinder-volume[83863]: INFO cinder.image.image_utils [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Converted 1024.00 MB image at 190.79 MB/s Apr 28 19:27:22 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2de8308c-809d-4a29-8227-227afd67becf is being set with open permissions: ugo+rw Apr 28 19:27:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2de8308c-809d-4a29-8227-227afd67becf {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:22 devstack sudo[94071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2de8308c-809d-4a29-8227-227afd67becf Apr 28 19:27:22 devstack sudo[94071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:22 devstack sudo[94071]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2de8308c-809d-4a29-8227-227afd67becf" returned: 0 in 0.658s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:22 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Lock "cinder-quobyte-2de8308c-809d-4a29-8227-227afd67becf" released by "_copy_volume_from_snapshot" :: held 8.835s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:27:22 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Acquiring lock "cinder-quobyte-910b3134-0a0d-4c0a-9765-8abe68169b40" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:27:22 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Lock "cinder-quobyte-910b3134-0a0d-4c0a-9765-8abe68169b40" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:27:22 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Deleting offline snapshot 910b3134-0a0d-4c0a-9765-8abe68169b40 of volume e4dfb15c-39d3-42b3-a276-9ea429ee10b3 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 19:27:22 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] snapshot_file for this snap is: volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3.910b3134-0a0d-4c0a-9765-8abe68169b40 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 19:27:22 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e223d6-776e-4778-93e9-d6b6fd8ff2a6]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:27:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3.910b3134-0a0d-4c0a-9765-8abe68169b40 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:22 devstack sudo[94074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3.910b3134-0a0d-4c0a-9765-8abe68169b40 Apr 28 19:27:22 devstack sudo[94074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:23 devstack sudo[94074]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3.910b3134-0a0d-4c0a-9765-8abe68169b40" returned: 0 in 0.784s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:23 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:27:23 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7902bc9a-3beb-403b-8869-b4017ec876fd]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:27:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:23 devstack sudo[94080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3 Apr 28 19:27:23 devstack sudo[94080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:24 devstack sudo[94080]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3" returned: 0 in 0.743s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3.910b3134-0a0d-4c0a-9765-8abe68169b40 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:24 devstack sudo[94086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3.910b3134-0a0d-4c0a-9765-8abe68169b40 Apr 28 19:27:24 devstack sudo[94086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:25 devstack sudo[94086]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3.910b3134-0a0d-4c0a-9765-8abe68169b40" returned: 0 in 0.742s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3.910b3134-0a0d-4c0a-9765-8abe68169b40 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:25 devstack sudo[94092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3.910b3134-0a0d-4c0a-9765-8abe68169b40 Apr 28 19:27:25 devstack sudo[94092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:25 devstack sudo[94092]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3.910b3134-0a0d-4c0a-9765-8abe68169b40" returned: 0 in 0.647s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:25 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Lock "cinder-quobyte-910b3134-0a0d-4c0a-9765-8abe68169b40" released by "_delete_snapshot" :: held 3.012s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:27:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.751s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:27:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0a76f59f-1708-4184-a057-e0d81d40c95a tempest-CinderUnicodeTest-924680598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.226s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:27:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0a76f59f-1708-4184-a057-e0d81d40c95a tempest-CinderUnicodeTest-924680598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T17:27:10Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1597134121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07342e2f-242b-48f9-990c-c65ab2103ee0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96578aae93ba4e759f9effaa51d814c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T17:27:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T17:27:10Z,use_quota=True,user_id='89b195fb07a844d08823ff41392be76c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f7cd683-5eb7-425e-a3a9-9da67268368c),volume_type_id=7f7cd683-5eb7-425e-a3a9-9da67268368c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 19:27:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-0a76f59f-1708-4184-a057-e0d81d40c95a tempest-CinderUnicodeTest-924680598 None] Creating volume 07342e2f-242b-48f9-990c-c65ab2103ee0 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 19:27:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0a76f59f-1708-4184-a057-e0d81d40c95a tempest-CinderUnicodeTest-924680598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:27:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0a76f59f-1708-4184-a057-e0d81d40c95a tempest-CinderUnicodeTest-924680598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:27:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0a76f59f-1708-4184-a057-e0d81d40c95a tempest-CinderUnicodeTest-924680598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:27:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0a76f59f-1708-4184-a057-e0d81d40c95a tempest-CinderUnicodeTest-924680598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:27:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0a76f59f-1708-4184-a057-e0d81d40c95a tempest-CinderUnicodeTest-924680598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:27:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0a76f59f-1708-4184-a057-e0d81d40c95a tempest-CinderUnicodeTest-924680598 None] Selected osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 19:27:25 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-0a76f59f-1708-4184-a057-e0d81d40c95a tempest-CinderUnicodeTest-924680598 None] casted to osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd Apr 28 19:27:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0a76f59f-1708-4184-a057-e0d81d40c95a tempest-CinderUnicodeTest-924680598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-07342e2f-242b-48f9-990c-c65ab2103ee0 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3436437d-0a55-4f7c-b851-563c6b808523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2de8308c-809d-4a29-8227-227afd67becf', 'volume_size': 1, 'source_volid': 'e4dfb15c-39d3-42b3-a276-9ea429ee10b3', 'source_volstatus': 'available'}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:27:25 devstack sudo[94095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-07342e2f-242b-48f9-990c-c65ab2103ee0 1073741824 Apr 28 19:27:25 devstack sudo[94095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (121702ec-6272-4b36-9b4e-753929151864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:27:25 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Volume volume-2de8308c-809d-4a29-8227-227afd67becf (2de8308c-809d-4a29-8227-227afd67becf): created successfully Apr 28 19:27:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (121702ec-6272-4b36-9b4e-753929151864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:27:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Flow 'volume_create_manager' (2328b8d0-01d2-4a2f-924b-1e268c11f005) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:27:25 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-50ad241c-a838-4313-b6b5-bf059cffc216 tempest-VolumeDependencyTests-637805770 None] Created volume successfully. Apr 28 19:27:26 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d4071dd2-5944-49f9-b17a-792600197eed tempest-VolumeDependencyTests-637805770 None] Acquiring lock "cinder-e4dfb15c-39d3-42b3-a276-9ea429ee10b3-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:27:26 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d4071dd2-5944-49f9-b17a-792600197eed tempest-VolumeDependencyTests-637805770 None] Lock "cinder-e4dfb15c-39d3-42b3-a276-9ea429ee10b3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:27:26 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d4071dd2-5944-49f9-b17a-792600197eed tempest-VolumeDependencyTests-637805770 None] Acquiring lock "cinder-quobyte-e4dfb15c-39d3-42b3-a276-9ea429ee10b3" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:27:26 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d4071dd2-5944-49f9-b17a-792600197eed tempest-VolumeDependencyTests-637805770 None] Lock "cinder-quobyte-e4dfb15c-39d3-42b3-a276-9ea429ee10b3" acquired by "delete_volume" :: waited 0.020s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:27:26 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc439c3-48a6-4557-813b-d5b890ac4900]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:27:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d4071dd2-5944-49f9-b17a-792600197eed tempest-VolumeDependencyTests-637805770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:26 devstack sudo[94101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3 Apr 28 19:27:26 devstack sudo[94101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:26 devstack sudo[94095]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0a76f59f-1708-4184-a057-e0d81d40c95a tempest-CinderUnicodeTest-924680598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-07342e2f-242b-48f9-990c-c65ab2103ee0 1073741824" returned: 0 in 0.979s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0a76f59f-1708-4184-a057-e0d81d40c95a tempest-CinderUnicodeTest-924680598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-07342e2f-242b-48f9-990c-c65ab2103ee0 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:26 devstack sudo[94104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-07342e2f-242b-48f9-990c-c65ab2103ee0 Apr 28 19:27:26 devstack sudo[94104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:27 devstack sudo[94101]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d4071dd2-5944-49f9-b17a-792600197eed tempest-VolumeDependencyTests-637805770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3" returned: 0 in 0.818s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d4071dd2-5944-49f9-b17a-792600197eed tempest-VolumeDependencyTests-637805770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:27 devstack sudo[94111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3 Apr 28 19:27:27 devstack sudo[94111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:27 devstack sudo[94104]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0a76f59f-1708-4184-a057-e0d81d40c95a tempest-CinderUnicodeTest-924680598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-07342e2f-242b-48f9-990c-c65ab2103ee0" returned: 0 in 0.628s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:27 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0a76f59f-1708-4184-a057-e0d81d40c95a tempest-CinderUnicodeTest-924680598 None] <== create_volume: return (1666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 19:27:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0a76f59f-1708-4184-a057-e0d81d40c95a tempest-CinderUnicodeTest-924680598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.669s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:27:27 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0a76f59f-1708-4184-a057-e0d81d40c95a tempest-CinderUnicodeTest-924680598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfef286d-763e-494d-9950-e45fb68dd563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07342e2f-242b-48f9-990c-c65ab2103ee0', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:27:27 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0a76f59f-1708-4184-a057-e0d81d40c95a tempest-CinderUnicodeTest-924680598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54531a01-ad72-4c28-b9e6-d5511bc1091d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 19:27:27 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-0a76f59f-1708-4184-a057-e0d81d40c95a tempest-CinderUnicodeTest-924680598 None] Volume volume-07342e2f-242b-48f9-990c-c65ab2103ee0 (07342e2f-242b-48f9-990c-c65ab2103ee0): created successfully Apr 28 19:27:27 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0a76f59f-1708-4184-a057-e0d81d40c95a tempest-CinderUnicodeTest-924680598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54531a01-ad72-4c28-b9e6-d5511bc1091d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 19:27:27 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0a76f59f-1708-4184-a057-e0d81d40c95a tempest-CinderUnicodeTest-924680598 None] Flow 'volume_create_manager' (91075125-b85d-4ac9-9c98-b6df3bb8bbf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 19:27:27 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-0a76f59f-1708-4184-a057-e0d81d40c95a tempest-CinderUnicodeTest-924680598 None] Created volume successfully. Apr 28 19:27:28 devstack sudo[94111]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d4071dd2-5944-49f9-b17a-792600197eed tempest-VolumeDependencyTests-637805770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-e4dfb15c-39d3-42b3-a276-9ea429ee10b3" returned: 0 in 0.664s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:28 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d4071dd2-5944-49f9-b17a-792600197eed tempest-VolumeDependencyTests-637805770 None] Lock "cinder-quobyte-e4dfb15c-39d3-42b3-a276-9ea429ee10b3" released by "delete_volume" :: held 1.555s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:27:28 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-d4071dd2-5944-49f9-b17a-792600197eed tempest-VolumeDependencyTests-637805770 None] Created reservations ['d9ce8a24-91c3-4c60-917e-57c915be685c', 'cfcdab30-f1f2-440a-919e-9b8b43bbd102', '46358018-9078-4429-9c0b-607c443701b3', '26d9106a-1623-4258-8bd0-bbfd15eb3195'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:27:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d4071dd2-5944-49f9-b17a-792600197eed tempest-VolumeDependencyTests-637805770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:27:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d4071dd2-5944-49f9-b17a-792600197eed tempest-VolumeDependencyTests-637805770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:27:28 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d4071dd2-5944-49f9-b17a-792600197eed tempest-VolumeDependencyTests-637805770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:27:28 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d4071dd2-5944-49f9-b17a-792600197eed tempest-VolumeDependencyTests-637805770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:27:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d4071dd2-5944-49f9-b17a-792600197eed tempest-VolumeDependencyTests-637805770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:27:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d4071dd2-5944-49f9-b17a-792600197eed tempest-VolumeDependencyTests-637805770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6e10ccc5-ac3a-45fe-94eb-55119c39d960 tempest-CinderUnicodeTest-924680598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:27:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6e10ccc5-ac3a-45fe-94eb-55119c39d960 tempest-CinderUnicodeTest-924680598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:27:28 devstack sudo[94114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:27:28 devstack sudo[94114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:28 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-6e10ccc5-ac3a-45fe-94eb-55119c39d960 tempest-CinderUnicodeTest-924680598 None] Creating offline snapshot 824ec9b7-793c-47a8-8f94-f9a003506a74 of volume 07342e2f-242b-48f9-990c-c65ab2103ee0 {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 19:27:28 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf0e1d8-045d-4fb6-87e7-4a5b0cc8c05a]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:27:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6e10ccc5-ac3a-45fe-94eb-55119c39d960 tempest-CinderUnicodeTest-924680598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-07342e2f-242b-48f9-990c-c65ab2103ee0 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:28 devstack sudo[94116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-07342e2f-242b-48f9-990c-c65ab2103ee0 Apr 28 19:27:28 devstack sudo[94116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:28 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-1fdf4e1e-b395-4db5-8435-922b0c7f422e tempest-VolumeDependencyTests-637805770 None] Acquiring lock "cinder-2de8308c-809d-4a29-8227-227afd67becf-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:27:28 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-1fdf4e1e-b395-4db5-8435-922b0c7f422e tempest-VolumeDependencyTests-637805770 None] Lock "cinder-2de8308c-809d-4a29-8227-227afd67becf-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:27:28 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-1fdf4e1e-b395-4db5-8435-922b0c7f422e tempest-VolumeDependencyTests-637805770 None] Acquiring lock "cinder-quobyte-2de8308c-809d-4a29-8227-227afd67becf" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:27:28 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-1fdf4e1e-b395-4db5-8435-922b0c7f422e tempest-VolumeDependencyTests-637805770 None] Lock "cinder-quobyte-2de8308c-809d-4a29-8227-227afd67becf" acquired by "delete_volume" :: waited 0.044s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:27:28 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e620a5-7c2e-4334-953c-fe1d9c2e6442]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:27:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1fdf4e1e-b395-4db5-8435-922b0c7f422e tempest-VolumeDependencyTests-637805770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2de8308c-809d-4a29-8227-227afd67becf {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:28 devstack sudo[94114]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d4071dd2-5944-49f9-b17a-792600197eed tempest-VolumeDependencyTests-637805770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.655s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:28 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-d4071dd2-5944-49f9-b17a-792600197eed tempest-VolumeDependencyTests-637805770 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:27:28 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-d4071dd2-5944-49f9-b17a-792600197eed tempest-VolumeDependencyTests-637805770 None] Deleted volume successfully. Apr 28 19:27:29 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d4071dd2-5944-49f9-b17a-792600197eed tempest-VolumeDependencyTests-637805770 None] Lock "cinder-e4dfb15c-39d3-42b3-a276-9ea429ee10b3-delete_volume" released by "delete_volume" :: held 2.512s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:27:29 devstack sudo[94119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2de8308c-809d-4a29-8227-227afd67becf Apr 28 19:27:29 devstack sudo[94119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:29 devstack sudo[94116]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6e10ccc5-ac3a-45fe-94eb-55119c39d960 tempest-CinderUnicodeTest-924680598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-07342e2f-242b-48f9-990c-c65ab2103ee0" returned: 0 in 0.845s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6e10ccc5-ac3a-45fe-94eb-55119c39d960 tempest-CinderUnicodeTest-924680598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-07342e2f-242b-48f9-990c-c65ab2103ee0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-07342e2f-242b-48f9-990c-c65ab2103ee0.824ec9b7-793c-47a8-8f94-f9a003506a74 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:29 devstack sudo[94124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-07342e2f-242b-48f9-990c-c65ab2103ee0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-07342e2f-242b-48f9-990c-c65ab2103ee0.824ec9b7-793c-47a8-8f94-f9a003506a74 1G Apr 28 19:27:29 devstack sudo[94124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:29 devstack sudo[94119]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1fdf4e1e-b395-4db5-8435-922b0c7f422e tempest-VolumeDependencyTests-637805770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2de8308c-809d-4a29-8227-227afd67becf" returned: 0 in 0.754s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1fdf4e1e-b395-4db5-8435-922b0c7f422e tempest-VolumeDependencyTests-637805770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2de8308c-809d-4a29-8227-227afd67becf {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:29 devstack sudo[94129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2de8308c-809d-4a29-8227-227afd67becf Apr 28 19:27:29 devstack sudo[94129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:30 devstack sudo[94124]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6e10ccc5-ac3a-45fe-94eb-55119c39d960 tempest-CinderUnicodeTest-924680598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-07342e2f-242b-48f9-990c-c65ab2103ee0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-07342e2f-242b-48f9-990c-c65ab2103ee0.824ec9b7-793c-47a8-8f94-f9a003506a74 1G" returned: 0 in 0.780s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6e10ccc5-ac3a-45fe-94eb-55119c39d960 tempest-CinderUnicodeTest-924680598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07342e2f-242b-48f9-990c-c65ab2103ee0 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-07342e2f-242b-48f9-990c-c65ab2103ee0.824ec9b7-793c-47a8-8f94-f9a003506a74 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:30 devstack sudo[94134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07342e2f-242b-48f9-990c-c65ab2103ee0 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-07342e2f-242b-48f9-990c-c65ab2103ee0.824ec9b7-793c-47a8-8f94-f9a003506a74 Apr 28 19:27:30 devstack sudo[94134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:30 devstack sudo[94129]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1fdf4e1e-b395-4db5-8435-922b0c7f422e tempest-VolumeDependencyTests-637805770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-2de8308c-809d-4a29-8227-227afd67becf" returned: 0 in 0.621s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:30 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-1fdf4e1e-b395-4db5-8435-922b0c7f422e tempest-VolumeDependencyTests-637805770 None] Lock "cinder-quobyte-2de8308c-809d-4a29-8227-227afd67becf" released by "delete_volume" :: held 1.439s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:27:30 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-1fdf4e1e-b395-4db5-8435-922b0c7f422e tempest-VolumeDependencyTests-637805770 None] Created reservations ['e52c1194-ee9b-4316-845d-f50fed112007', '2174b7b1-7995-4949-bbdc-f484ded73011', '42ef014f-242a-41ac-8158-825e7c766b41', 'f6f86511-8362-4ba7-b26a-e2f5fa3c221b'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:27:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1fdf4e1e-b395-4db5-8435-922b0c7f422e tempest-VolumeDependencyTests-637805770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:27:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1fdf4e1e-b395-4db5-8435-922b0c7f422e tempest-VolumeDependencyTests-637805770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:27:30 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1fdf4e1e-b395-4db5-8435-922b0c7f422e tempest-VolumeDependencyTests-637805770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:27:30 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1fdf4e1e-b395-4db5-8435-922b0c7f422e tempest-VolumeDependencyTests-637805770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:27:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1fdf4e1e-b395-4db5-8435-922b0c7f422e tempest-VolumeDependencyTests-637805770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:27:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1fdf4e1e-b395-4db5-8435-922b0c7f422e tempest-VolumeDependencyTests-637805770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:30 devstack sudo[94137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:27:30 devstack sudo[94137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:30 devstack sudo[94134]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6e10ccc5-ac3a-45fe-94eb-55119c39d960 tempest-CinderUnicodeTest-924680598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07342e2f-242b-48f9-990c-c65ab2103ee0 -F qcow2 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-07342e2f-242b-48f9-990c-c65ab2103ee0.824ec9b7-793c-47a8-8f94-f9a003506a74" returned: 0 in 0.647s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:30 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-6e10ccc5-ac3a-45fe-94eb-55119c39d960 tempest-CinderUnicodeTest-924680598 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-07342e2f-242b-48f9-990c-c65ab2103ee0.824ec9b7-793c-47a8-8f94-f9a003506a74 is being set with open permissions: ugo+rw Apr 28 19:27:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6e10ccc5-ac3a-45fe-94eb-55119c39d960 tempest-CinderUnicodeTest-924680598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-07342e2f-242b-48f9-990c-c65ab2103ee0.824ec9b7-793c-47a8-8f94-f9a003506a74 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:30 devstack sudo[94144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-07342e2f-242b-48f9-990c-c65ab2103ee0.824ec9b7-793c-47a8-8f94-f9a003506a74 Apr 28 19:27:30 devstack sudo[94144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:31 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ae4b0cbf-2a7f-4687-8305-6e73b6e26d71 tempest-VolumeDependencyTests-637805770 None] Acquiring lock "cinder-9fb322f0-db37-4367-a796-8a5ca80515c4-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:27:31 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ae4b0cbf-2a7f-4687-8305-6e73b6e26d71 tempest-VolumeDependencyTests-637805770 None] Lock "cinder-9fb322f0-db37-4367-a796-8a5ca80515c4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:27:31 devstack sudo[94137]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1fdf4e1e-b395-4db5-8435-922b0c7f422e tempest-VolumeDependencyTests-637805770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.625s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:31 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-1fdf4e1e-b395-4db5-8435-922b0c7f422e tempest-VolumeDependencyTests-637805770 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:27:31 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-1fdf4e1e-b395-4db5-8435-922b0c7f422e tempest-VolumeDependencyTests-637805770 None] Deleted volume successfully. Apr 28 19:27:31 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ae4b0cbf-2a7f-4687-8305-6e73b6e26d71 tempest-VolumeDependencyTests-637805770 None] Acquiring lock "cinder-quobyte-9fb322f0-db37-4367-a796-8a5ca80515c4" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:27:31 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-1fdf4e1e-b395-4db5-8435-922b0c7f422e tempest-VolumeDependencyTests-637805770 None] Lock "cinder-2de8308c-809d-4a29-8227-227afd67becf-delete_volume" released by "delete_volume" :: held 2.337s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:27:31 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ae4b0cbf-2a7f-4687-8305-6e73b6e26d71 tempest-VolumeDependencyTests-637805770 None] Lock "cinder-quobyte-9fb322f0-db37-4367-a796-8a5ca80515c4" acquired by "delete_volume" :: waited 0.015s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:27:31 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[01012081-d7b1-4251-b631-1329edc4eec4]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:27:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ae4b0cbf-2a7f-4687-8305-6e73b6e26d71 tempest-VolumeDependencyTests-637805770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9fb322f0-db37-4367-a796-8a5ca80515c4 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:31 devstack sudo[94149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9fb322f0-db37-4367-a796-8a5ca80515c4 Apr 28 19:27:31 devstack sudo[94149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:31 devstack sudo[94144]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6e10ccc5-ac3a-45fe-94eb-55119c39d960 tempest-CinderUnicodeTest-924680598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-07342e2f-242b-48f9-990c-c65ab2103ee0.824ec9b7-793c-47a8-8f94-f9a003506a74" returned: 0 in 0.637s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6e10ccc5-ac3a-45fe-94eb-55119c39d960 tempest-CinderUnicodeTest-924680598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-07342e2f-242b-48f9-990c-c65ab2103ee0.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:31 devstack sudo[94151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-07342e2f-242b-48f9-990c-c65ab2103ee0.info Apr 28 19:27:31 devstack sudo[94151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:31 devstack sudo[94149]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ae4b0cbf-2a7f-4687-8305-6e73b6e26d71 tempest-VolumeDependencyTests-637805770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9fb322f0-db37-4367-a796-8a5ca80515c4" returned: 0 in 0.714s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ae4b0cbf-2a7f-4687-8305-6e73b6e26d71 tempest-VolumeDependencyTests-637805770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9fb322f0-db37-4367-a796-8a5ca80515c4 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:31 devstack sudo[94157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9fb322f0-db37-4367-a796-8a5ca80515c4 Apr 28 19:27:31 devstack sudo[94157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:31 devstack sudo[94151]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6e10ccc5-ac3a-45fe-94eb-55119c39d960 tempest-CinderUnicodeTest-924680598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-07342e2f-242b-48f9-990c-c65ab2103ee0.info" returned: 0 in 0.626s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:31 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-6e10ccc5-ac3a-45fe-94eb-55119c39d960 tempest-CinderUnicodeTest-924680598 None] /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-07342e2f-242b-48f9-990c-c65ab2103ee0.info is being set with open permissions: ugo+rw Apr 28 19:27:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6e10ccc5-ac3a-45fe-94eb-55119c39d960 tempest-CinderUnicodeTest-924680598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-07342e2f-242b-48f9-990c-c65ab2103ee0.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:31 devstack sudo[94159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-07342e2f-242b-48f9-990c-c65ab2103ee0.info Apr 28 19:27:31 devstack sudo[94159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:32 devstack sudo[94157]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ae4b0cbf-2a7f-4687-8305-6e73b6e26d71 tempest-VolumeDependencyTests-637805770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-9fb322f0-db37-4367-a796-8a5ca80515c4" returned: 0 in 0.612s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:32 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ae4b0cbf-2a7f-4687-8305-6e73b6e26d71 tempest-VolumeDependencyTests-637805770 None] Lock "cinder-quobyte-9fb322f0-db37-4367-a796-8a5ca80515c4" released by "delete_volume" :: held 1.367s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:27:32 devstack sudo[94159]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6e10ccc5-ac3a-45fe-94eb-55119c39d960 tempest-CinderUnicodeTest-924680598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-07342e2f-242b-48f9-990c-c65ab2103ee0.info" returned: 0 in 0.588s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6e10ccc5-ac3a-45fe-94eb-55119c39d960 tempest-CinderUnicodeTest-924680598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.215s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:27:32 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-6e10ccc5-ac3a-45fe-94eb-55119c39d960 tempest-CinderUnicodeTest-924680598 None] Create snapshot completed successfully Apr 28 19:27:32 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-ae4b0cbf-2a7f-4687-8305-6e73b6e26d71 tempest-VolumeDependencyTests-637805770 None] Created reservations ['2dea8d95-9b32-4bee-a6d4-6c5ed865916e', '59a5a351-2f1c-49d0-94c2-155c310baf4b', '93f8427a-e95c-4ece-b1dc-c5c625ed6c53', '61c21b37-df25-43f4-a5f3-d33109774e95'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:27:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ae4b0cbf-2a7f-4687-8305-6e73b6e26d71 tempest-VolumeDependencyTests-637805770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:27:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ae4b0cbf-2a7f-4687-8305-6e73b6e26d71 tempest-VolumeDependencyTests-637805770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:27:32 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ae4b0cbf-2a7f-4687-8305-6e73b6e26d71 tempest-VolumeDependencyTests-637805770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:27:32 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ae4b0cbf-2a7f-4687-8305-6e73b6e26d71 tempest-VolumeDependencyTests-637805770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:27:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ae4b0cbf-2a7f-4687-8305-6e73b6e26d71 tempest-VolumeDependencyTests-637805770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:27:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ae4b0cbf-2a7f-4687-8305-6e73b6e26d71 tempest-VolumeDependencyTests-637805770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:32 devstack sudo[94163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:27:32 devstack sudo[94163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:33 devstack sudo[94163]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ae4b0cbf-2a7f-4687-8305-6e73b6e26d71 tempest-VolumeDependencyTests-637805770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.587s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:33 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-ae4b0cbf-2a7f-4687-8305-6e73b6e26d71 tempest-VolumeDependencyTests-637805770 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:27:33 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-ae4b0cbf-2a7f-4687-8305-6e73b6e26d71 tempest-VolumeDependencyTests-637805770 None] Deleted volume successfully. Apr 28 19:27:33 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ae4b0cbf-2a7f-4687-8305-6e73b6e26d71 tempest-VolumeDependencyTests-637805770 None] Lock "cinder-9fb322f0-db37-4367-a796-8a5ca80515c4-delete_volume" released by "delete_volume" :: held 2.185s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:27:33 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a227d4b3-afa0-46f0-a899-3903346524b0 tempest-CinderUnicodeTest-924680598 None] Acquiring lock "cinder-824ec9b7-793c-47a8-8f94-f9a003506a74-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:27:33 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a227d4b3-afa0-46f0-a899-3903346524b0 tempest-CinderUnicodeTest-924680598 None] Lock "cinder-824ec9b7-793c-47a8-8f94-f9a003506a74-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:27:33 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a227d4b3-afa0-46f0-a899-3903346524b0 tempest-CinderUnicodeTest-924680598 None] Acquiring lock "cinder-quobyte-07342e2f-242b-48f9-990c-c65ab2103ee0" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:27:33 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a227d4b3-afa0-46f0-a899-3903346524b0 tempest-CinderUnicodeTest-924680598 None] Lock "cinder-quobyte-07342e2f-242b-48f9-990c-c65ab2103ee0" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:27:33 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a227d4b3-afa0-46f0-a899-3903346524b0 tempest-CinderUnicodeTest-924680598 None] Acquiring lock "cinder-quobyte-824ec9b7-793c-47a8-8f94-f9a003506a74" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:27:33 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a227d4b3-afa0-46f0-a899-3903346524b0 tempest-CinderUnicodeTest-924680598 None] Lock "cinder-quobyte-824ec9b7-793c-47a8-8f94-f9a003506a74" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:27:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-a227d4b3-afa0-46f0-a899-3903346524b0 tempest-CinderUnicodeTest-924680598 None] Deleting offline snapshot 824ec9b7-793c-47a8-8f94-f9a003506a74 of volume 07342e2f-242b-48f9-990c-c65ab2103ee0 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 19:27:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-a227d4b3-afa0-46f0-a899-3903346524b0 tempest-CinderUnicodeTest-924680598 None] snapshot_file for this snap is: volume-07342e2f-242b-48f9-990c-c65ab2103ee0.824ec9b7-793c-47a8-8f94-f9a003506a74 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 19:27:33 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f2e7e0-8482-43f4-8a17-e5111d94e4d1]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:27:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a227d4b3-afa0-46f0-a899-3903346524b0 tempest-CinderUnicodeTest-924680598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-07342e2f-242b-48f9-990c-c65ab2103ee0.824ec9b7-793c-47a8-8f94-f9a003506a74 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:33 devstack sudo[94166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-07342e2f-242b-48f9-990c-c65ab2103ee0.824ec9b7-793c-47a8-8f94-f9a003506a74 Apr 28 19:27:33 devstack sudo[94166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:34 devstack sudo[94166]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a227d4b3-afa0-46f0-a899-3903346524b0 tempest-CinderUnicodeTest-924680598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-07342e2f-242b-48f9-990c-c65ab2103ee0.824ec9b7-793c-47a8-8f94-f9a003506a74" returned: 0 in 0.745s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:34 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-a227d4b3-afa0-46f0-a899-3903346524b0 tempest-CinderUnicodeTest-924680598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07342e2f-242b-48f9-990c-c65ab2103ee0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 19:27:34 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae82369-8509-4d06-8e8d-eea1b59b880d]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:27:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a227d4b3-afa0-46f0-a899-3903346524b0 tempest-CinderUnicodeTest-924680598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-07342e2f-242b-48f9-990c-c65ab2103ee0 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:34 devstack sudo[94171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-07342e2f-242b-48f9-990c-c65ab2103ee0 Apr 28 19:27:34 devstack sudo[94171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:35 devstack sudo[94171]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a227d4b3-afa0-46f0-a899-3903346524b0 tempest-CinderUnicodeTest-924680598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-07342e2f-242b-48f9-990c-c65ab2103ee0" returned: 0 in 0.749s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a227d4b3-afa0-46f0-a899-3903346524b0 tempest-CinderUnicodeTest-924680598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-07342e2f-242b-48f9-990c-c65ab2103ee0.824ec9b7-793c-47a8-8f94-f9a003506a74 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:35 devstack sudo[94176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-07342e2f-242b-48f9-990c-c65ab2103ee0.824ec9b7-793c-47a8-8f94-f9a003506a74 Apr 28 19:27:35 devstack sudo[94176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:35 devstack sudo[94176]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a227d4b3-afa0-46f0-a899-3903346524b0 tempest-CinderUnicodeTest-924680598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-07342e2f-242b-48f9-990c-c65ab2103ee0.824ec9b7-793c-47a8-8f94-f9a003506a74" returned: 0 in 0.674s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a227d4b3-afa0-46f0-a899-3903346524b0 tempest-CinderUnicodeTest-924680598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-07342e2f-242b-48f9-990c-c65ab2103ee0.824ec9b7-793c-47a8-8f94-f9a003506a74 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:35 devstack sudo[94182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-07342e2f-242b-48f9-990c-c65ab2103ee0.824ec9b7-793c-47a8-8f94-f9a003506a74 Apr 28 19:27:35 devstack sudo[94182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:36 devstack sudo[94182]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a227d4b3-afa0-46f0-a899-3903346524b0 tempest-CinderUnicodeTest-924680598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-07342e2f-242b-48f9-990c-c65ab2103ee0.824ec9b7-793c-47a8-8f94-f9a003506a74" returned: 0 in 0.586s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:36 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a227d4b3-afa0-46f0-a899-3903346524b0 tempest-CinderUnicodeTest-924680598 None] Lock "cinder-quobyte-824ec9b7-793c-47a8-8f94-f9a003506a74" released by "_delete_snapshot" :: held 2.877s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:27:36 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a227d4b3-afa0-46f0-a899-3903346524b0 tempest-CinderUnicodeTest-924680598 None] Lock "cinder-quobyte-07342e2f-242b-48f9-990c-c65ab2103ee0" released by "delete_snapshot" :: held 2.898s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:27:36 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-a227d4b3-afa0-46f0-a899-3903346524b0 tempest-CinderUnicodeTest-924680598 None] Created reservations ['60fd44a8-0f72-41e7-8ea0-7c0b935aeb68', 'c5c67dff-76b7-4d9b-846a-4d391c5f988d', 'd34ba2b2-0f15-4d40-9f0a-f752ee6570fc', '630a128b-3886-4c2b-a94c-a1d0fd68c867'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:27:36 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-a227d4b3-afa0-46f0-a899-3903346524b0 tempest-CinderUnicodeTest-924680598 None] Delete snapshot completed successfully. Apr 28 19:27:36 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a227d4b3-afa0-46f0-a899-3903346524b0 tempest-CinderUnicodeTest-924680598 None] Lock "cinder-824ec9b7-793c-47a8-8f94-f9a003506a74-delete_snapshot" released by "delete_snapshot" :: held 3.018s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:27:36 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8df4eae3-714f-4cb7-99f3-6f986f418bba tempest-CinderUnicodeTest-924680598 None] Acquiring lock "cinder-07342e2f-242b-48f9-990c-c65ab2103ee0-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:27:36 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8df4eae3-714f-4cb7-99f3-6f986f418bba tempest-CinderUnicodeTest-924680598 None] Lock "cinder-07342e2f-242b-48f9-990c-c65ab2103ee0-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:27:36 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8df4eae3-714f-4cb7-99f3-6f986f418bba tempest-CinderUnicodeTest-924680598 None] Acquiring lock "cinder-quobyte-07342e2f-242b-48f9-990c-c65ab2103ee0" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:27:36 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8df4eae3-714f-4cb7-99f3-6f986f418bba tempest-CinderUnicodeTest-924680598 None] Lock "cinder-quobyte-07342e2f-242b-48f9-990c-c65ab2103ee0" acquired by "delete_volume" :: waited 0.016s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:27:36 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4497ac-5cfa-4825-918c-2ae82d76fd36]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:27:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8df4eae3-714f-4cb7-99f3-6f986f418bba tempest-CinderUnicodeTest-924680598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-07342e2f-242b-48f9-990c-c65ab2103ee0 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:36 devstack sudo[94185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-07342e2f-242b-48f9-990c-c65ab2103ee0 Apr 28 19:27:36 devstack sudo[94185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:37 devstack sudo[94185]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8df4eae3-714f-4cb7-99f3-6f986f418bba tempest-CinderUnicodeTest-924680598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-07342e2f-242b-48f9-990c-c65ab2103ee0" returned: 0 in 0.707s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8df4eae3-714f-4cb7-99f3-6f986f418bba tempest-CinderUnicodeTest-924680598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-07342e2f-242b-48f9-990c-c65ab2103ee0 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:37 devstack sudo[94191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-07342e2f-242b-48f9-990c-c65ab2103ee0 Apr 28 19:27:37 devstack sudo[94191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:38 devstack sudo[94191]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8df4eae3-714f-4cb7-99f3-6f986f418bba tempest-CinderUnicodeTest-924680598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-07342e2f-242b-48f9-990c-c65ab2103ee0" returned: 0 in 0.594s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:38 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8df4eae3-714f-4cb7-99f3-6f986f418bba tempest-CinderUnicodeTest-924680598 None] Lock "cinder-quobyte-07342e2f-242b-48f9-990c-c65ab2103ee0" released by "delete_volume" :: held 1.351s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:27:38 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-8df4eae3-714f-4cb7-99f3-6f986f418bba tempest-CinderUnicodeTest-924680598 None] Created reservations ['473bef75-5ff0-4a43-bcc1-d75dbe6d88d5', '2a126c19-9de4-42ae-bd21-85a3fb7b1b38', '86c8fac0-b02b-4c78-93e0-9f3c6bdba733', 'f3e6a3a4-da02-4e3f-b1e6-b7811624710c'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:27:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8df4eae3-714f-4cb7-99f3-6f986f418bba tempest-CinderUnicodeTest-924680598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:27:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8df4eae3-714f-4cb7-99f3-6f986f418bba tempest-CinderUnicodeTest-924680598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:27:38 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-8df4eae3-714f-4cb7-99f3-6f986f418bba tempest-CinderUnicodeTest-924680598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:27:38 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-8df4eae3-714f-4cb7-99f3-6f986f418bba tempest-CinderUnicodeTest-924680598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:27:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8df4eae3-714f-4cb7-99f3-6f986f418bba tempest-CinderUnicodeTest-924680598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:27:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8df4eae3-714f-4cb7-99f3-6f986f418bba tempest-CinderUnicodeTest-924680598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:38 devstack sudo[94194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:27:38 devstack sudo[94194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:38 devstack sudo[94194]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8df4eae3-714f-4cb7-99f3-6f986f418bba tempest-CinderUnicodeTest-924680598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.600s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:38 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-8df4eae3-714f-4cb7-99f3-6f986f418bba tempest-CinderUnicodeTest-924680598 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:27:38 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-8df4eae3-714f-4cb7-99f3-6f986f418bba tempest-CinderUnicodeTest-924680598 None] Deleted volume successfully. Apr 28 19:27:38 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8df4eae3-714f-4cb7-99f3-6f986f418bba tempest-CinderUnicodeTest-924680598 None] Lock "cinder-07342e2f-242b-48f9-990c-c65ab2103ee0-delete_volume" released by "delete_volume" :: held 2.147s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:27:38 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-eb4e1979-1fbb-4177-be09-1001d1bdd108 tempest-CinderUnicodeTest-924680598 None] Acquiring lock "cinder-bf992e0e-660f-45f8-b23f-0fee1a2a2641-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:27:38 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-eb4e1979-1fbb-4177-be09-1001d1bdd108 tempest-CinderUnicodeTest-924680598 None] Lock "cinder-bf992e0e-660f-45f8-b23f-0fee1a2a2641-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:27:39 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-eb4e1979-1fbb-4177-be09-1001d1bdd108 tempest-CinderUnicodeTest-924680598 None] Acquiring lock "cinder-quobyte-bf992e0e-660f-45f8-b23f-0fee1a2a2641" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 19:27:39 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-eb4e1979-1fbb-4177-be09-1001d1bdd108 tempest-CinderUnicodeTest-924680598 None] Lock "cinder-quobyte-bf992e0e-660f-45f8-b23f-0fee1a2a2641" acquired by "delete_volume" :: waited 0.014s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 19:27:39 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d57839-be90-4c0f-b85a-641fcfa25cbe]: (4, 'qcow2') {{(pid=85107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 19:27:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-eb4e1979-1fbb-4177-be09-1001d1bdd108 tempest-CinderUnicodeTest-924680598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bf992e0e-660f-45f8-b23f-0fee1a2a2641 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:39 devstack sudo[94197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bf992e0e-660f-45f8-b23f-0fee1a2a2641 Apr 28 19:27:39 devstack sudo[94197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:39 devstack sudo[94197]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-eb4e1979-1fbb-4177-be09-1001d1bdd108 tempest-CinderUnicodeTest-924680598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bf992e0e-660f-45f8-b23f-0fee1a2a2641" returned: 0 in 0.700s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-eb4e1979-1fbb-4177-be09-1001d1bdd108 tempest-CinderUnicodeTest-924680598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bf992e0e-660f-45f8-b23f-0fee1a2a2641 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:39 devstack sudo[94202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bf992e0e-660f-45f8-b23f-0fee1a2a2641 Apr 28 19:27:39 devstack sudo[94202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:40 devstack sudo[94202]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-eb4e1979-1fbb-4177-be09-1001d1bdd108 tempest-CinderUnicodeTest-924680598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c/volume-bf992e0e-660f-45f8-b23f-0fee1a2a2641" returned: 0 in 0.599s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:40 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-eb4e1979-1fbb-4177-be09-1001d1bdd108 tempest-CinderUnicodeTest-924680598 None] Lock "cinder-quobyte-bf992e0e-660f-45f8-b23f-0fee1a2a2641" released by "delete_volume" :: held 1.347s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:27:40 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-eb4e1979-1fbb-4177-be09-1001d1bdd108 tempest-CinderUnicodeTest-924680598 None] Created reservations ['bb119a76-03cf-497e-a1e2-ad96662499e6', '30c92b5d-c301-407e-b81b-d6b555e81e83', 'b7edf64b-1dba-490d-8a66-dc08719f125e', '1b0a0956-bb66-489b-a1b7-0269f8510b8a'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 19:27:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-eb4e1979-1fbb-4177-be09-1001d1bdd108 tempest-CinderUnicodeTest-924680598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 19:27:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-eb4e1979-1fbb-4177-be09-1001d1bdd108 tempest-CinderUnicodeTest-924680598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 19:27:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-eb4e1979-1fbb-4177-be09-1001d1bdd108 tempest-CinderUnicodeTest-924680598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 19:27:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-eb4e1979-1fbb-4177-be09-1001d1bdd108 tempest-CinderUnicodeTest-924680598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7ecb1f5-fe73-414e-adb7-75222fb674fd'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 19:27:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-eb4e1979-1fbb-4177-be09-1001d1bdd108 tempest-CinderUnicodeTest-924680598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 19:27:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-eb4e1979-1fbb-4177-be09-1001d1bdd108 tempest-CinderUnicodeTest-924680598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 19:27:40 devstack sudo[94239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c Apr 28 19:27:40 devstack sudo[94239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 19:27:41 devstack sudo[94239]: pam_unix(sudo:session): session closed for user root Apr 28 19:27:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-eb4e1979-1fbb-4177-be09-1001d1bdd108 tempest-CinderUnicodeTest-924680598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b3d2bc30b5d3be2e750e680301bf4f5c" returned: 0 in 0.640s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 19:27:41 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-eb4e1979-1fbb-4177-be09-1001d1bdd108 tempest-CinderUnicodeTest-924680598 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 19:27:41 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-eb4e1979-1fbb-4177-be09-1001d1bdd108 tempest-CinderUnicodeTest-924680598 None] Deleted volume successfully. Apr 28 19:27:41 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-eb4e1979-1fbb-4177-be09-1001d1bdd108 tempest-CinderUnicodeTest-924680598 None] Lock "cinder-bf992e0e-660f-45f8-b23f-0fee1a2a2641-delete_volume" released by "delete_volume" :: held 2.182s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 19:27:50 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:SELECT=85,cinder:INSERT=32,cinder:UPDATE=124,cinder:DELETE=6 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 19:27:51 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:INSERT=30,cinder:UPDATE=114,cinder:SELECT=73,cinder:DELETE=11 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}